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jbitroduction 



This book is an elaboration of a course given hy the aythor at Moscow 
University for pupils in the ninth and tenth grades, ^n it we discuss the 
development through abstraction of the general definition of distance 
and introduce a class of spi^ces in which the n#tion^ of distance is 
defined, the so^aJled metric 'spaces. It will be evident from our dis- 
cussion that the general concept of distance is relate to a large number 
of jnathematiral phenomena- y 

With the kid of the concept of distance, it is possible to study problems 
concerning ths shortest" path between two points on a surtace, the. 
geometric properties df muUidimensional spaces, mcthods^f "noise** 
reduction in the coding of information, and methods of ** smoothing*' 
errors in the results of empirical measurcm?nts, as wfeU as many other 
such topics, . . • * ml ^ 

The concept of **distance," moreover, is a good ^lustration* of the 
role played in mathematics by the generalization of specific ideas,tthe 
results of which 'at times find some rather unexpected applications. 
Other good examples of such gpneralizatibn% which have beea found 
indispensable to many areas of mathematics may^also cited: the 
notions of function, limit, space, and traosformaiion, as well as the less 
familiar concepts of isomorphism, groiip, ring, and so on. Of these 
^ examples^ however, the concept o^distance s'feems most suited to the 
type of elementary discussion required by the inexperience of our 
audience, a consideration which is the chief mo^tivation for our choice 
of this particular topic. Our aim is to demonstrate by means accessible 
to a wide range of readers the way in which one fruitful idea can shed 
ii^ht on a wide variety of mathematical questions and, at the same time, 
serve as a source of new resuUs^and insight in some particular field of 
knowledge. This situation, characteristic of all of the sciences, appears 
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viii . In^oduction 

quite often in mathematics ifi particularly striking ways, making 
possible a clear understanding \vithout the necessity of mastering a. 
myriad of confu^ng details. The ipateriai for this book has been chosen] 
with this general idea in mind. » ^ - ! 

The first four chapters are intended to expose the reader to the 
generalization of the ordinary geometric definition of distance and to 
the illustration of the generalized concept via concrete situations, x 
Chapter 5 describes the so-called spiace of information, a concept that 
plays a major role in the theory of information and the general theory 
of communication. Chapter 6idealsWth methods of cocfing information 
which allow that information to be relatively unaffected by errors in the 
process of transmission. Since in all real communications devices, 
en^s occur in a number of ways, such metheds of coding are ^|sential 
for modern systems of comipunication and control. For example^n the 
transmissicjn of photographs from the far sid€^ of the mo^n by a Soviet ' 
space vehicle, errornn&ducing methods of codification had to be used. 
It is important to note that each of thes^ methods involves the use of 
the generalized concept of distance in the space of information. 

The material in chapter 7 is somewhat morc^cbmpljcatcd ; there we 
with an important class pf spaces to which the notion of distance ii^ 
common. Chapter 8 describes the application of the generalized concept 
of distance to the problem of '* smoothing'*' errors in the results of 
empirical measuremei^s---th<e problem of finding a mathematical 
process which wjli nearly eliminate the effect of error in experimental 
data. This chaptA is -pssentialiy an exposition of the method of least 
squares. Some knowledge of difTcrential calculus is necessary for an . 
understanding oPtnis chapter. The reader who has not had the necessary 
background may omit this section. 

In the final chapter, the possibility of further generalization of the 
concept of distance is examined. In this chapter I wish primarily to show 
that it is not necessarily tru^that^ll generalizations possess interesting 
properties. It is not always easy to develop a good generalization of a^ 
mathematical concept. At the p6>re of any worthwhile generalization are • 
some essential properties of the real world. In particular, the concept of 
distaricc is important because many essential properties of real objects 
are related to their mutual disposition, which can frequently be chax- 
acteri/ed by a pr6fH:riy deiined 4:oncept of distance. For example, 
although it is impossibijito describe the electrons of an atom as px)int 
masses, quantum mechanics, is nevertheless able to determine the 
''distance'' between the two ener^*states of electrons. This "distance'' 
is related conceptually to the "distance'' defmed in the so-calledy2 
space discussed in chapter 7, , ■ „ * 
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Iniroduciloi^ 

I shall consider my task Mmplctc if this\lKK)k is able to give the r»der 
a satisfactory understanding of the ideas ijicntioned above. • 

I wish- to take this opportunity to exj^r^ my gratitude to L M. \ 
Yaglom^ who has provided much valu;^blc advice conwmin^ the 
improvement of this manuscript \ 
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The Definition 
of Mathematical 
Concepts 



At first glance, the titl^ of this book may seem surpdsing. Every 
schoolboy, it would seem, kno^v5 what distance is, Even a person wfib 
has completely forgotten his hi^h-school geometry and who cannot 
accurately formulate a definition of distance would he quick to assert 
that.he knows very well what distance is. ^ 
But, in fact, the matter is much niore cbmpli9ated. 
The word distance can take on different meanings depending upon 
what particular space one is talking about. We are about to sec that this 
is true even in situations with, which we are well acquainted, ^ 

jn the Euclidean plane ancf in ordinary 
three-dimensional Euclidean space, the 
distance between two points M and 
is defined as the length of the line 
segment MN joining those points. 
When dealing witli distances between 
geographical loci on the surface of the 
earthj however, we usually have in mind 
the length of the smaller arc of the gceat 
^ circle joifiing tltese localities. The dif- 
ference between these two meanings of 
distance becomes particularly noticeable ' 
if we calculate the distance between the 
north pole A' and the south pole 5 (see fig. 1 . 1 The ordinary (Euclidean) 
distance bct^vieen the poles is equal to the diameter of the earth, 
approximately S,OCX) miles. The distance tetweer^the poles along the 
surface of the earth is", however, greater than this by a factor of ^/2; it 
is ^bout 12,500 miles., ^ 

To this example one might ^d that, in commerce, even the means of the 
transportation to be used must be taken into account in the estimation 




Fig. I.l 



0 2 The Definition of. Mathematical Coadpts 

of distances between cities. For example, tKe distance between two points* 
by may differ from the distance by train. - « 

r . We^can obtain another example of distance if we consider points^in 
rugged terrain and define the distance between two such points as the 
time necessary for someone on foot to travel from one point to another. 
* , ' It is cfear that'this distance has nothing in common with the length of 
the line sdgment joining two points^ for the straight line, in general, is 
not the besi or most possible path. Indeed, afoot traveler will calculate 
the distance between two points by the time he spends in travel between ' ♦ 
them. 

Despite differences among these means of measurement, however, it ( 
^s evident that all meanings taken on by the word distance iiave some- 
thing in common. A measure of **how far apart** two objects are is 
always indicated. Tfius, one may syp'pose that there exists some common 
definition of distance ''v^ich has various interpretations in various 
concrete situations. Such a general definition will be formulated in • 
chapter 3. But first we shall consider what, i^ general, is necessary for 
the definition of a mathematical concept. . 

Modern mathematics is the language of natural science. Underlying 
the most important mathematical ideas are spatial-temporal facts about 
the world in which we live. However, the relationship between these 
^ facts and the corresponding mathematical ideas is sometimes very 
complicated. 

In every branch of mathematics are some fundamental concepts 
• w^ich are related in our minds to certain physical images. Some of the 
fundamental properties of these concepts are formulated as axioms (or 
postulates); truths" that are not proved iput accepted as a^ starting^ 
point. All of the remaining propositions of the given branch of mathe- 
matics are derived logically from these axioms without reference to the 
properties of the pTiysical world. The very formulation of a set of axioms 
expresses to some degree the relationship between intuitive knowledge 
of propcrfies associated with these ideas and the empirically obvious 
properties of their physical forms. ^ ^ 

Some of the most important concepts involved in geometry are the 
ideas point, straight line, plane, space, ^knd so on. In a systematic 
geometry course it is necessary to develop a list of tbe most basic 
properties of these concepts in the form of a set of axioms, theT)asis on 
which the .whole structure of geometry is built. ^ 

Some of the principal concepts involved in algebra are those of sets of 
numbers and operations on these numbers. For example, the structure 

^ 1. The first toVashion such an ex[>osit!on of geometry was the ancient Greek 
mathematician Hufclid (fourth third century b.c). 
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Tite Definition of Mathematical Concepts ^ 3 

of the integers, rational numbers, plgebraic numbers, real numbers, 
complex numbers, and so on, are studted. 

In each of the five number systems specifically mentioned above, one 
can verijy that certain fpndamental laws concerning operations on 
numbers are satisfied. These are* the commutative la^ for addition 
(a + b ^ b + a), the associative law for addition {[a + b] + c = 
a .+ [b + c]), the commutative law for multiplication {ab = ba), the 
associative law for multiplication {[(i^]c = a[bc]), the distributive law 
([a + b]c = ar + be), and the rules a - a == 0, a x I ja =^ \ for a 0, 
which char^fctlrize the relationship between the principal operations 
(addition and multiplication) and their inverses (subtraction and divi- 
sion). All of these laws are satisfied in the number systems listed -above 
to SVhich they apply. However,Mt is not always the case that a given 
operation is defined in a ^iven number system. Division is not always 
]>ossible within the integers and, therefore, -is not well-de^ned as an 
operation on the set of integers. If a number system contains only- 
positive numbers, subtraction is not always possible. As it happens, 
certain rules for^lgebraic transformation of various expressions depend 
only on the properties listed above. For example, all of the rules for the 
solution of first-degree equations and systems of such equations are 
"based upon these laws and upon the possibiHty of carrying out the 
operation of division. ^ 

It turns out, in fact/ that, it is possible to study many properties of 
various number systems as consequences of the general theory of 
systems on whiclj^^ned operations (called a^idition and multiplication) 
satisfy the properties listed above.. Such systems arc ter^ied commutative 
rings or fields in ,nTt>dern algebra (depending on whether it is always 
possiblejp' carry out division)*^ 

It is possible to view the rules for transformation of expressions and 
^for solution of equations in the case of an ar'Siti^ field or rin^ and to 
loojj: at the rules normally developed in high-school algebra as special 
cases. 

^ In contemporary algebra, rings and fields are usually studied as 
gencraliz;ations of number systems studied in high school. The basic 
properties of operations that can be carried out for integers or for 
rational numbers are set down as a starting point, Imd facts that may be 
derived logically using the^c properties alone are stuped. 
' In taking this, approaj^h, mathematicians arc interested not only in 
discovering ne\(v properties of* the physical world and establishing 
relationships among these properties, but also in clarifying properties of 

2. For a definition of r/w and fieUt see Birkhoff and MacLanc, A Survey of 
Modern Algebra {New York: Macmillan, 1965). 
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» 

"imaginary'' w/>rlds developed by using axioms similar to those of the 
noml^r systems most closely related to physitf^ reality. 
^ ♦ This facet of mathematics is no less importam than the possibility of 
dpscribing the physical world. The Russian mathematician N. 1. 
Lobachevskii, by altering one of Euclid's postulates, created, an 
"imaginary" geometry, which, long afterwards, served as the basis of 
^ ^ new physical ceixept| of the universe arising from Einstein ''s develop- 
ment of the theory of relativity, 

. In this book" we shall study one of the most important of mathe- 
matical concepts— the concept of distance. ' ^^1^ ' 
*Oui; first attempt ^11 be the listing of those' properties of distarR 
which are essential tmeleffienftiry geom^ry. With these laws our 
' 4>asis, shall derive the definition of a so-called* m^/r/c space and study 
vadous examples of s,uch space^./We shall see that*such a specifically ^ 
mathematical approach-to the 'study of certain concepts from the point 
of view- of a generalized concept reveals many interesting facts. " 
This approach— the creation of generalized concepts and the attempt 
*^to describe physic&l realities, with the aid of these concepts — is- char- • 
^acteristic of modern mathematic;3 and its fields of applicafjon.^ From * 
this point of view, tl^concep! of distance provides a good q,xample of 
the fruitfulness of such an approach, " 

3. We must not overlook the role played In cybernetics by such generaUzed 
mathematicaJ concepts as information, automata theory, and algorithm, ^ 
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Distance ^and 
Ite Properties in 
ll^mentary 
leometry 



We hope to arrive at a general definition of distance by gcnerali^frig 
the properties of ordinary** distanca in thr^imensional Euclidean 
spac^e. Therefore, we shall first attempt to list t^ie fundamental properties 
•of ordinary distance. 

Let us agfee to denote the' distance between two points M and N in 
tfiree-dimtnsional space— the. length of the line segment A/Af— as 

This notatbn emphasizes the fact that the distance between M and N 
IS a real number which is completely determined by pointS'A/ and M In 
'other words, distance is a real-Valued function of pairs of points. If we 
characterize each point by an ©rdered triple of coordinates, say M = 
{x, y,z) and {xu yu ^hen distance m three-space becomes a 
function of six variables; ^ 

* 

' diM, N) =■ /"(at, y, z, y^, rO . 





Fig. 2,1 



Fig. 2.2 



With the aid of figure 2. 1 , one can derive a closed algebraic expression 
for this function, Pictured is a parallelepiped with sides parallel to the 
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6 Distance and Its Properties In Beztmitary Qc^>Is^try 

coordinate axes. We know that the square of the length of the diagonal 
of a parallelepiped is eqilal to the sum of the square of the lengths of ^ 
its sides. Consequently, * ^ 

or ^ * - ^ 



. ^ d{M, N) - Vix - + Xy^ y^y + (2 - z^^ . (2.1) 

It is even simpler to calculate the distapc^ between the points M ^ (x, y) 
and N ^ {xu yi) irt the EuclmSn plane (sec fig. 2.2). For this 
calculation, >ye ne«i only note that the length of the line segn\ent ML is 
just |x - Xi\, and,, similarly, that the length of the lipe segment ZJV is 
\y - :j^it. By the Pythagois^m theorem, 

MN^ - ML" + LN^ , 

so that . 



d{M,.N) - Vix - xO^ + iy 4 ytf . ' \ (2.2) 

Despite the importance of equations (2.1) anp (2.2), the properti^ 
.of distance that we shall need can be obtained withput, the use of a » 
coordinate system. . 

These pr,operties^can be formulated as .follows: 

1. d{M, fi) - d{N, M) (symmetry). 

2. d{M,N) ^ 0 (nonnegativity), 

3. d{M, A^) = 0 if and "only if the points hf and coincide (jion- 
degeneracy). 

4. d{M, N) < d{M, L) + d{L, N) for arbitrary points M, N, and L 
{the triangle inequality). 

Properties 1,2, and 3 are obviously basic to Euclidean distance. They 
indicate simply that the length of the segment MN is equal to the 
. length of the segment NM^ that this length is always nonnegative, and 
that it is equal to zero if and only if the two cndpoints of the segment 
coincide. 

Property 4« becomes evident if we draw the plane determined by the 
points Af, L, and N (and, therefore, containing the triangle MLN) 
(fig. 2.3). Property 4 then indicates oniy that the length of side MN does 
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not exceed the sum of the lengths of the remaining s^iies of the triangle 
(henc^ the name triangle inequalityy In other wo^jds, the straight line 
segment MN is the .shortest patix joining the poii^s Af and N. 





Fig. 2.4 



In faptfthe tfian^ in^uality becomes & strict kiegidolity {</(A/, N) < 
dm^ t) +,d{L/N)] in Euclidean three-space when we introduce the 
"added i;cstrictibn that do€^ not lie on scgmsjnt MN. Hence, we can 
/concIude;tha)t the 'lerig^h of segment MN is strictly less than the Icngtl% 
of a brQkcniline consisting of an arbitrary finite number of segments 
' who^ unio^^ joins the points M and N In order to justify this conclusion 
(fig, 5)| we shall repeatedly decrease by one thd number of segments in 
the broken Hnp, until, finally, only t>vo segments remain. At each step 
. in this process the length of the broken line will be strictly lessened until 
we reach the segment MN itself Thus, in figure 2.4 we go from the 
^ken line MLxULqN to the broken line ML^L^N, then to the broken 
/ line WLaA^, and finally to the segment MN. E^ch time the length of the 
broken segment decreases, and thus the length of the original broken 
.line, is ^^trictly greater than the length of the segment MN. 
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Broken line 



hs length 



Application of the strict 
triangle inequality 



MLd-^N d(M, LO + d{Lt, U) + diU. ^) d{M. L{) + d{Lu U) > d(M, 
ML^N d(M, Li) f N) d(M. 4 A^) > d(M, N) 

MN d{M, N) 
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8 Distance and Its Rropcrtie^ in Elementary Geometry 

*- ' 

Let us note that in this deduction'^we use only the strict triangle 
inequality for.E^lidean space. This qan be best illustrated by table 2.L 
From this table it>is evident how, by replacing the^sums in the second 
column by ^sser sums using the inequalities from the third column, we 
arrive at the conclusion that * ' * * ^ * 

in addition, we use the fact that the length of a ciirve is the lir^it 
of tHe lengths gf broken segments approximating the curve, it is ^qs^ble 
to prove tn^ following assertion : ^ / * 

Of all the paths foming points M- and N, the straight line segmenp MN 
has tbe smallest length. , ' : , 

From the triangle inequality it foliowfe that v 



dm N) > d{M, N) - d{M, L) . . i (2.3) 

Let us emphasize that equality holds in the triangle inequality for our 
three-dimensional examf>le if and only if the points Af, iV, and L lie on 
the same straight line and L is located "betweerj" M and iV (that is, L 
lies on the segment MN). 

Let us nowiexamine a distance function on the surface of a^ sphere 5 
pf radius r, ' 

We define the distance between two |Joints M and N on the surface of, 
a -sphere as the length of the smaller arc of the great circle passi^ 
through the points M and TV. Let us recall that a circle lying'on tfte 
surface of a sphere is called a great circle if its center cbincid^^' w^th the 
center of the sphere. In other words, a great circle lie^'op the /lane 
passing through the points and O (O beifig the c^entefpf the 

sphere). It follows that each pair of distinct points M and N uniquely 
determines a great circle, since three distinct points uniquely determine 
a plane. The distance d^iM, N) defined in this way. Clearly satisfies 
properties 1,2, and 3. it is not difficult to see further that for arbitrary 
points M and on the sphere, 

* ' dsiM, N) ^nr, (2.4) 

« 

with equality holding only for points M and N lying at the endpoints of 
a diameter of the sphere (for example, the North and South Poles). 
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■ * 

To verify the fourth distance property, 
it is necessary to examine the spherical 
triangle (fig- 2.S. (The point O is 
the center ofthe sphefe.) 
ItiscI^Aat 

- dsiL,M) =^ ry, 

where a, /5, and y arc the radian measures 
of angles MON, LON, smA ibM, . 
, . ^ ^ respecfively. • , 

If is well known that in such a trih^ral'^ngle none of the planar 
angles exceeds the sum of the .two other planar angles; in p^qular; 

" * • ' " a 5 jS + y . • '. . - ' ' (2.5) 

Multiplying both sides of this inequality by the ra^us i*^ v/esobtaln 




or ^ 



■ ^ ds{M, N) ^ dsiM, L) + ds(L, N) , (2.6) 

the inequality we set out to establish* J \ ♦ 

Thus, all of the fundamental prapertics of ordinary distance arc 
satisfied by the spherical di^nce rfs(Af, A^). ^ 
' It is easy to show that equaiity holds in inequality (2.6) if and only if 
two conditions are •satisfied; first, that the point L is located on the 
3ame great circle as jthe'po^^^^ ^ second, that L lies 

between"' M and N—on the smaller arc of the great circle determined 

This follows from the fact that inequality (2.6) becomes an equality 
only when equality holds in (2.5). But this can occur only when the 
trihedral angle degener^s into a planar one— that is^when the points 
M, A^, and L lie on a plane passing through the center O ofthe sphere 
and ray OL is located between rays OM and CWV. But this implied that 
the point L lies on the smaller arc of the great circle joining points M 
and My 

It is evident that the smaller arc of the great circle joining points 
and possesses properties analogous to those of the straight hne 
segment in ordinary (non&pherical Euclidean) geometry. In particular, 
(1) through a pair of arbitrary distinct points there passes exactly one 
such arc (with the exception of the case where the points M and lie at 
the eiidpoints of a diameter of the sphere— that is, where thfty are 
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10 Distant and Xt$ Properties in Elementary Geon^^ 

antipodal — in which case both arcs o£ any ^rcat circle joirting M and N 
are of equal length, and there arc infinitely many such circles) j (2) for 
any point i lying on such an arc joining the points M and iV, the equatio;i 

' • ^ d^M,l) + d^L,N)^d^M,N) , ' 

holds. - * 

^ Let ^Snotc at this point an infportant extension of a fact provori in 

• Euclidean thr^space. For ordinary distance we have shown that the 

length of any broken line joining two points M and Mas greater than 

the distance Hfctwccn the points Af and iV, that is, than the length of the 

segment MN. Here we h^ our reasoning only on ttie triangle in- 

. equality and on the fact that equality holds oftly if the points Af, £, and 

iV*!ie bp the same segment '(with L "betwten*' Af and N). ^ncc the 

triangle^nequality is afso true for the 3istance function have defined , 

on the sphere, with the ordinary line ^^ment corresponding Kerp to t^e 

smaller arc of a great circle, it is apparent that an analogous assertion 

is true on the sphere: If the points M and are joined by a broken 

sequence of arcs of great circles (fig. 2.S) in which, sua^ssive arcs arc 

joined by a common endpoint, then the total length of such a spherical 

broken line*' is greater than the distance d^M, 

We suggest that the reader write up a full proof of this assertion in 

analogy with the proof for ordinary distance carried out above. This 

assertion can easily be generalized (using limit arguments) in the 

following form : The length of the smaller arc of the great circle joining 

the points^ and N is less than the length of any other path on the 

sphere connecting these points. 

Thus, we have examined two examples of disfance and determined 

that their fundamental properties are the same. Auxiliary proper^es 

such as (2.4) (p. 8), properties peculiar 

to the particular example, play a much 

smaller role. 

Therefore, our next step will be to 

take 'Jhe fundamental properties qf 

distance ( 1 , 2, 3, and 4) as axioms and to 

study various spaces in which a distance 

» satisfying these axioms is defined. In 

this chapter we have "examined two 

elementary examples of such spaces: 

ordinary Euclidean three-space and the 

Fig. 2.6 surface of the sphere. 

1. We must assume here, of course, that this sequence actually is "feroken"; 
that is, that it docs not He entirely on the smaller arc of the great circle joining the 
points M and A'. 
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We shall begin with an explanation of what a set is, Lilcc the notion of 
point in geometry, the concept of set is fundamental and yet difficuI^to 
define. The word set is used in mathematics to indicate a collection of 
objects called elements of the'sct. 

The concept of set has important applications in any situation whCTC 
a general property is assigned to certain objects- When these objects 
fall into some class according to some sort of rule, they form a set. We 
shall say that a set contains each of its elements^ and that each element 
of a given set is contained in it. A set is considered specified if for any 
arbitrary object it is pos^blc to determine whether or not it is contained 
in the given set.^ * 

Let us consider, for example, the set of all integers. The sSn is not 
contained in this set as it is not a number but an object of an entirely 
different sort The number n is not contained in this Set, for it is not 
integral. On the other hand, the roots of fhe equation j^^ - 3x + 2 = 0 
arc contained in this set. It is possible to examine the set of all planets 
of the solar system, where we d^ne planets as bodies moving around 
the sun in a closed orbit and weighing no less than one tdn. The sun is 
not contained in this set, since it does not (strictly) move around itself. 
The earth is contained in this set. The15D>iet rocket launched from the 
earth into an prbit about the sun on January 2, 1959, is also contained 
in this set; it is an artiT5cial planet. 

Let E be some set and N one of its elements. This relation iS written 
symbolically as jV 6 £ and is read ^^N is an element of A symbolic 

L The Question of what sort of method of determination is to be considered 
"effective" is of great interest in mathematical logic and philosophy, but it will 
not concern us here. An analogous difficulty is inherent in all formal classification 
systems. As an example, wc may cite the biological diflSculty in defining what sort 
of anthropomorphic beings bcloi^ to the class Homo sapiens. 

ir 
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notation of the type K = {L, A/, A^, . . .) is also used, where each 
eienien^of the set is eni^efated within the bractcets. Thus, the set f^, 
consistfig of all of the capitals of the Soviet republics, could be written 
symbolically as = {Moscow, Kiev, Minsk, Tbilisi, Yerevan, Baku, 
.Riga, Talljn>i, Vilnius, Tashkent, Alma-Ata, Frunze, Ashkhabad, 
^yushambe, Kishinev). W 

if every element of a set E is at the same time an element of a set E^; 
the set £■ is called a subset of the set Ei. This is written as £" c: £^ ("£ is 
contained'm Ex*). For example, th^^sej of all integers is a subset of the 
set of all real numbers * . ! • 

A set E i^ called finite if each of its elements can be^issociated wUh 
(mapped to) a different element ^ of ^some set of the, form BL=^ {1, 2, 
3, . .^, rl). In other words; for a set £ to 5e finUe, ther^ muj^xist a 
function f from E to ^ff^uck that for each^air of elements a and b in 
£, F{a) = £(6) implies a ^ b. For eJCa'mple, the Set E^ of capitals of the 
Soviet republics is finite, since it is possible to enumerate this set using 
the elements of the se^ E^^ as is evident from table 3. 1 . 

Table 3.1 



Moscow 1 
Kiev 2 
Minsk 3 
Tbilisi 4 



Yerevan 5 
Baku 6 
Riga 7 
Tallinn 8 



Vilnius 9 
Tashkent 10 
Alma-Ata 1 1 
Frunze 12 



Ashkhabad 13 
Dyushambe 14 
Kishinev 15 



We are now in a position to give a definition of a metric space. 

A metric space (£, d) is a set £ in which for each pair of elements M 
and N a real number d{M^ N) is defined and the following properties 
are satisfied : 

1. d{M, N) - £/(JV, M) (symmetry). 

2. d{My N) > 0 (nonnegativity)^ 

3. diM, N) - 0 if and only if M and N are the same element 
(nondegeneracy), 

4. d{M,f^) < d{M,L) ^ diL,N)^ror each triple {M, L) oi 
elements of the sel'£ (triangle inequality). 

We shall call the elements of the set £ the points of the space ijt, d). 
A metric space is thus completely determined by the choice of tlrc set £ 
and the function d — the distance function in the space. For tJKe sake of 
simplicity, we shall denote a given space by the same letter as its 
corresponding set, although, in fact, the space and the set of its elements 
are quite difierent objects. In fact, it is often possible to define more 
than one distance function on a space £; each such function, along with 
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the set E, determines a different metric spac». In chaf)tcr*4 we shaH 
construct new definitions of distance (and thus new metric spaces) in^ 
tne plane. 

In place of the four distance axioms listed above, it is possible to 
< ' / introdupc only two (supposing as before that ^(Af , N) is a number) i 
V. diM.N) = d if-and only if the points Mand ATUie the siame- 
*^2'. diM, N) ^ d{M, L) + diN, L). 

' First of all, these properties follow from properties 1, 2^ 3, and 4, as 
property V is property \ and property T follows from the triangle 
inequality and -condition 1. 

On the other han^ from properties I'N^d T alone it is possible to 
deduce all oTthe conditions 1^2, 3, and 4/^ • 
To prove this, let us suppose first that in 1\ L ^^Af, so that 

\ ' r 

d{M,^N)<.d{M,M)^i{N,M). „ 

. By r, d{M, M) = 0. Therefore, d{M, N) < diN, M). By interchang- 
ing in 2' the positions of points Af and N and canning out the analogous 
argument, we see that^(A^, M) <. d{M,N). from these last two in- 
equalities we get the axiom of symmetry (1): > 

d{M,N) = diN,M). 

Substituting M for A' and for L in 2', we get 
• • diM, M) ^ d{M, N) + diM, N) = 2diM, N) , 

so that, by virtue of I 

0 ^ 2diM, N) , 

implyirig 

0 i d^, N) , 

which is . property IJjjonnegativity). Again, using the condition -of 
symmetry which we proved above, we can interchange N and L in the 
second term on the right side of 2' and get the triangle incquaHty 4. 
Thus, the System of axioms i' and 2' is equivalent to the system 1, 2,^3, 
and 4. It is more convenient to use the latter system, howevef, as it 
gives in a clearer form the same fundamental properties of distance. 
Still, it is interesting to note that all of these properties can be embodied 
in a pair of axioms. 
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From the point of view of the definition ^ich we fiave introducai, 
the content of the preceding chapter might be dcsqrifcsfcd as a proof that 
the set of points in three-dimensional Euch'deart" space along with a 
distance fufiction definwi as the length of the line segment joining a 
^iven pair of points is a metri^ space. In the end of the same chapter, 
we established that the set of points on the surface of a sphere", together 
with the distance function ^4, form a metric space. 

We can get another example of a metric space if we consider the set 
of points of some surface # in three^imensional spac^ and define the 
distance d^^iM, N) as the minimum length of the paths passing along 
the surface ir and joining thcpoints M and N.^ TTie^st thrro properties 
of distance are then immediately evident, ' 

The triangle inequality can be verified in the following manner: Let 
us connect the points M and L, as well as the points L and A^, by a path 
. of the shortest possible length. Let us then connect the points M and N 
using such minirhal paths ML and LM Clearly, the length of this path 
cannot be less than the length of the shortest path joining M and iV, 
since this path is itself a path jpH^ing M and N, and thus must be at 
least as long as the? shortest such path. Since the length of this path is 
d^iM, L) + d^{L, N), and the length of the shortest path between M 
and N is d^(M, N), the desired relation follows: 

d^m, N) < dJ^M, L) + d,{L, Ny. ' (3.1) 

Let us note that on the surface of the sphere the shortest path joining 
two points is the smaller arc of the great circle determined by them; this 
was proved at the end of the preceding chapter. The proof was based on 
the fact that the triangle inequality was obtained by an independent 
argument concerned only with the space determined by the surface of a 
sphere, and on our proof that equality holds in the triangle inequality if 
and only if L lies ''between'' M and on the smaller arc of a great 
circle, 

^ It is useful to introduce the concept ^f line segment in an arbitrary 
metric space. We shall define the line segment joining the points M an,d 
N in a metric space E to be the set E^j^ of ^points /. whict^ satisfy the 
equality 

J(M, A^) - d{M, L) -h dm N) (3.2) 

It is easy to see that for ordinary distance in the plane pr in three-space, 
. the set E^^i4 coincides with the line segment MN in the ordinary sense of 

2. f or the sake of simpHcily, we suppose that for each pair of points M and N 
on a given surface tt, there exists some shortest path between M and M Using 
certain assumptions concerning the properties of the surface tt^ it is possible to 
prove this supposition. O ' i 
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the term. On the sphere S with the distance function 4 introduced in 
chapter 2, the segment Ey^^^ is the smaller arc of the great circle joining 
the points M and NifM and N do not lie on the same diameter, and tte 
whole sphere if the points M and N are antipodal. 

We leave it for the reader to verify that with the distance dJ,M, N) 
in^^oduccd above, the line segment Eu,n <if it is indeed ^ unique path) 
is the shortest path {the so-called geodesic line) joining the pomts Af 
and JV. i ^ 

It is also possible lb generalize to an arbitrary metric spa(» E the 
con<»pt of the sphere Su,r with center Af and radius r as the set of points " 
JV for which «^M, JV) = . . • 

In the plane, this notion con^ponds to that of a circle; in three-space, 
to that of the ordinary sphere; Tor the metric (distance function) d^, to 
circles on the sphere S. 

As still another (trivial) example of a metric space, we take an arbi- 
trary set E and define tl\c distance between two points M and iV to be 
zero if they coincide, and one otherwise. It is easy to sec that all of the 
necessary conditions are Satisfied by this definition? 

Various other examples of metric spaces will be examined in chapter 4. 

In a metric space E it is always possible to define the concept of 
convergence to a limit for a sequence contained in E. Roughly speaking, 
a sequence of points in the metric space £, (Li, L2, . . ..Z.^, . . »), 
denoted by (1^)*.!, is said to converge to the point i- e £ if, beginning 
with some L^, the distance between' members of tjie sequence and the 
point L (the limit) becomes smaiier than any previously chosen positive \ 
number. 

''Formally, the sequence (L^)^.! is said to converge to L if for every 
positive real number e it is possibje to choose a positive integer fid) $Jt\i 
that the condition k > w(e) implies ^ 

d{UL^ < 

In keeping with the ordinary notation, we wjite 

r 

It is easy to verify that for the metric space consisting of all real 
numbers R with a metric J defined by ' 
f 

reneral definition of limit coincides with the usual one. 



L ~ lim . 
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' For the metric space U^, Euclidean three-space with the usual metric, 
the concept of limit just defined allows us to state dearly what we mean 
by the limit of a sequence of points in thrw-space. 

Let us note that in this case the set of points Af for which A/) < m 
forms the interior of a sphere with qenterLand^ radius e, A sequence of* 
points thus converges to the point L if and only if, for each 

£ > 0, there exists some integer n{e) such that all the points of the 
sequence witii k ^ n{s) lie in the interior of the sphere with cjenter L and 
radius s. " . 

Theorem. If the sequence of elements . , L^, • - - of the metric 

space E converges to a limit then for each e > 0 therelexists an integer 
m{e) such J hat the conditions^ k ^ and k' > m{s) imply that 
d{U,U') < e.. ^ 

Proof By the definition of limit, it is possi'blfe to choose an integer 
• n{el2) such that k > niejl) and k* > n{el2) willvmply the inequalities 



J(L„L)<i; c/(L,.,L)<^ 



But, by the triangle inequality and the axiom of symmetry, 



dm,L,) dm^L) + - d{L,,L).+ d{L,^J.) < | + f 



In other words Jf we let m(£.>== /7(f/2), then fo# > m(^j)arTuA' ^ m{e), 
the fpHowing inequality holSs; 

.. ^ ^ ^ ' ■ . * 

- dm,L^ ) < e . 

This proves the theorem. To paraphrase slightly, we have proved that 
if elements of a sequence become arbitrar^y to a given limit, 

they also become arbitrarily ''close" to cach:*>l^cr 

if in the space E the converse of the above theorem holds, then E is 

caiied complete. 

\ ' 

It is convenient to give the definition of a complete metric space in 
the following form: A sequence of points { 1/,)^- 1 contained in the 
metric space E is said to be a Cauchy sequence if for each £ > 0, there 
exist*; an integer m(f) such that k > mie) and k' > implies 



d{Lf,, Li,) < £ 



\ 
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The metric space £ is called complete if each Cauchy sequence in £ 
converges to a point «f ^« • . , 

' The real line, the plane, and thr^space with their usual metrics are 
' Complete metric spaces, ' 

The question of whether or not a given n^etric space is complete is 
fundamental to the application of these concepts in mathematical 
analysis, but we shall not conccro ourselves witK this question at the 
present time,^ 

' Two metric spaces aje said to be isometric if it is possible to set up a 
one-to-one correspondence between them such that*the djstanc^ between 
' a pair of points in one of the. spaces is the same as that between the 
corresponding points in the other space. From the point of view qf the 
theory of metric spaces, two isometric ^spaces may be considered* 
identical 

As an example, let the sp^ce £ be the plane along with the ordinary 
metric, and the space £' thd '|Et of cpmplcx iiumbers 2>with a metric 
defined by the formula • . - y ' , 

The usual method of picturing, the complex numbers as points on the 
plane establishes the existence of a one-to-one correspondence between 
the two spaces. It is easy to check that this correspondence is an 
isometry, since, if we set z = x + yi and Zx ^ Xi + yj, the quantity 
• ■ ^ * ^ 

\z - z,\ ^ Vix - xa)2 ^ iy - yif 

is equal to the distance between the corresponding points of the plane. 

The definitions of metric space and of distance given here are not the 
most generaUncountered in mathematics. There are various generaliza- 
tions o£ this«concept. For instance, it would seem possible to assign 
infinite distance to some pairs of points, while^still preserving all of the 
% properties of distanc^lilii^j generalization, as we shall see in chapter 9, 
is no^ particularly interesting. In many mathematical problems it is 
* necessary to deal with a>me>te-in which the property of symmetry is 
. lacking. We shall study the properties of such a metric in chapter 9. In 
the theory of relativity, it is necessary to consider a distance function 
whkh can take on even imaginary values. The properties of such a 
distance are quite unique, but we shall not touch upon them in this 
book. 

■ 3, The notion of completeness is of most importance to mathematical analysis 
when applied to metric spaces whose points at^ functions. See, for example, the 
definition of the space C at thf end of chapter 7. 
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In this chapter we shall look at a number of examples of metric 
spaces with r^ativeiy unusual metrics. 

Many interesting metric spaces on t^ie plane arise out of considcra- ' 
tion of differently defined distance functions. We shall represent tlie 
points of the plane in this discussion with the aid of a coordinate system 
' chosen once and for all so that each point of the plane is given by an 
ordered pair of coordinates (x, y). It will be conv^icat to denote a 
point of the plane as M = (x, y)*. 

The metric space / results when we define the distance between^ the 
points M ^ ix,y) and ^ = (xi, yi) by the formula 

- |x - xi\ + \y- y,\ . • - (4.1) 

Figure 2.2 (p. 5) shows that d^iM, N) is the sum of the lengths of the 
^ legs of the triangle MLN, in which MN is the hypotenuse and the legs 
artd LN are parallel io the axes of the coordinate system. Since the 
length of the hypotenuse cannot exceed the sum of the lengths of the , 
legs, we havfe always 

diM.N) <.d,iM.N), (4.2) 

where d{M,N.) is the usual* planar distance. The inequality (4.2) 
becomes-an equality 6n]y when the line segment MN is either horizontal 
or vertical — that is, when it is paraHei to one of the coordinate axes. 

If in Inequality (4.2) we substitute the algebraic expressions for the 
corresponding distance functions (4.1) and (2.2), we get the inequality 

V(x - x^f + {y- y{f <.}x - + b - y,\ . 
Setting x^~ ji = 0, we get the simple but important inequality 

Vx» +V 5 |xl + \y\ . (4.3) 
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Axioms 1, 2, and 3 are obviously satisfied by the metric d^iM, N). In 
order to verify that axiom 4 is also satisfied, we examine thrw points 
M = ix,y\ N r= {xuyOf and L = (xaij'a) and write the elementary 
identity- ^ ^^J) 

- xit+ \y - yi\ ^ \x- + x^- xi\ + \y - y2 + y2 - yi\ - 

f ' (4.4) 

Using the .fact that for arbitrary reaP numbers a and \a + b\ ^ 
4- \b\, from (4,4) we get the inequality 

\x - xi\ + \y- yi\ ^ \x - xa! + \x2 - xi\ + \y - y2\ + ^2 - yil 

wljich is the desired relation 

i/,(M, iV) ^ d,iM, L) + d,{L, N) . (4,5) 

And so the triangle inequality holds for the space A 

The distance di{M, N) can be interpreted as the length of a minimal 
path traversed by a particle moving from M to N that is constrained to 
move only along line segments parallel to the coordinate axes. Figure 
4.1 makes it evident that there are many (in fact, infinitely many) suc^ 
minimal paths. 

It is not hard to show that*^ statement is equivalent to saying that 
in the space / there exist infinitely many distinct line segments^ joining 
thfs points J9f and (except in the case where the points M and N are 
situated on the same vertical or horizontal line); for a line segn^nt in 
the space / joining the points M and N is any broken line joining M and 
jV which consists only of vertical and horizontal lines which do not 
intersect any vertical or horizontal line more than once. (We suggest 
that the realler prove this as an exercise*) ^ 




Fig. 4.1 Fig. 4.2 



1. In the sense of the definition introduced in Chapter 3. 
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One gets a still more natural picture by considering the metric space 
C consisting of all the lattice points of^some rectangular lattice in the 
plane (fig. 4.2) with the metric defined by fgrmula (4.1). Points of4his 
space can be viewed as the intersections of the streets of a perfectly 
planned city. The distance Ji(A/, A^) is in this case the length of the 
shortest path which one can take along the streets of the city from the 
intersection M to the intersection N, without taking any shortcuts 
through houses. 

In the following example, the space C will consist of points in the 
plane with the metric dj^ defined >y the formula 

flf«(M, N) = max {\x - x^l\y- }\\) , (4.6) 

where Af has coordinates (x, j) and has coordinates {xuyi). Geo- 
metrically (fig. 2.2), the distance do,(M, N) can be interpreted as the 
length of the larger leg of the triangle MLN. As this length is always less* 
than that of the hypotenuse (or equal to it in the case of a degenerate 
triangle), we have 

d^{M,N) ^ d{M,N) , (47) 

where d(^, N) is the usual planar distance. Again, setting Xi ^ yi - 0, 
we get the algebraic inequality / 



max(lx|, bl) < \/x^^ /, (4.8) 

For the metric axioms I, 2,jj;i^are again quite evident. Jo 
prove the triangle inequality, suppose we have three arbitrary points 
M = {x,y), A^-(xi,j^i), and L-^ix^.y^)- We may assume that 
\x - x^\ \y - yi\.^ This means that 

d^iM.N) max(|x - x^l \y - yi\) - |x - ^il 

^ Consequently, ^ 

d^iM, N) ^\x Xii[ + \X2- x,\. . (4.9) 

2. The meaning of the symbol oo will be made clear on page 22. 

3, Wc can make this assumption without loss oj generality, for in the opposite 
case - Ail < \y - yi\), we interchange the roles of the x and y coordinates 
and carry out the same proof. 



3,9 



Some Examples of Metric Spaces 21 
Moreover, it is evident that 

- xaj ^ max i\x - Xaj, \y - y2\) = ^/cp(Af, L) , 
\X2 - Xi\ < max i\x2 - x^l ly^ - yi\) = i/cc(/-, N) , 
Combining (4.9) and (4 10), we get 

^d^{M, N) ^ d4M. L) + d^U N) , (4. 11) 

the desired result 

We have already noted that in an arbitrafy-irictric space it is jK)Ssible 
to introduce the conirept of a sphere of radius r with center M, defined 
as the set of points for which ' 

d{M,N) = r . (4.12) 

^f the distance function d is the 
ordinary distance on the plane, this 
sphe'Ve is just the circle with center M 
and radius r. 

For three-space with the ordinary 
metric, the sphere defintd by (4.12) is 
just the ordinary sphere with center M 
and radius r. 

In the space / the sphere is a square 
with center M and diagonals of length 
^ Fig. 4.3 2r parallel to the coordinate axes. 

In the space C the sphere is also a 
square with center Af, but with sides of length 2r parallel to the co- 
ordinate a;ces. In figure 4.3 we have pictured the sphere of radius r in 
the spaces / and C and in the usual sense. The proof that spheres in / . 
and C have the form indicated above is left as an exercise for the reader. 

An interesting class of metric spaces is obtained when we define a 
metric d^ on the plane by the formula 

• d,{M, N) - - x^\^ + \y -y,\^. (4.13) 

The spaces so obtained are called /p spaces. 

Axioms 1,2, and 3 for a metric dp are obvious. The, triangle inequality 
follows from Minkowski\s inequality:* 

+ a,\^ + \b + b,\^ ^ ^\a\^ + \h\^ -f <'\a,\^ + \hj^ , (4.44) 

4. A proof of Minkowsky's inequality can be found in GeofTrcy H. Hardy, 
John E. Little wood, and George Polya, Inequalities (Ca^nbridge: The Unfversity 
Press, 1934). \ 

of I 
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which is true for /> ^ 1, if for the points M = (x, y), N = (xi, yi), and 
^ = {Jf2» ^st). wc take 

For p < 1, the triangle inequality is not true; the inequality in (4,14) is 
reversed. ^ 

It is easy to see that for /? = 1 the distance </p(Af, N) ^ <ii(A/, A^), 
whereas for p = 2 the distance dp(My N) is just the usual distance 
diM, N), Thus, the ^ace / coincides with the spac^ 1^ and the plane 
with the usual metric is the spac« /a. 

We shall now show that the distance dp{M, N) conY^|f^s to the 
distance </«(Af, iV) as -> oo. \ 

Let us first examine the case |jc - ;cj j > \y - yi\\ Then d^{M, N) = 
|x — ^^ij. On the other hand, transforming (4.13), we have 



rf^(M,iV) = \x--x,\^/l + 
Noticing that for /? > I, 



(4.15) 



y ~ yi 



^ I + 



yi 



X — Xi 



and that the quantity \iy - yi)[{x Xi)]" -as p-^oo (since 
\x - x^\ > \y - y,\ and, thus, \y - 7ij/|jf - x,\ - [(7 - 
(x - < I), we get 



I + 



X — Xi 



Using (4.15), we see that 



iim 4(A/, N) ^ \x - x,\ ^ d^iM, N) 



(4.16) 



Analogously, for |x - Xi| < \y - yx\, we obtain 



Hm d^iM, N)= \y^y,\ d^{M, N) . ' (4.17) 
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Finally, let us examine the case \x - Xi\ = b - ^-il. Then 

Since liifi = 1, we have in this case 

lim d^iM, ^) = ix - Xil - AT) . ^ 
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(418) 



And so in all three cases, by (4. 16), (4.17), and (4.18), we get 



lim 4,(A/. N) = d^{M, N) , 



(4.19) 



the desired result. 
Consequently, it is reasonable to denote the space C by the symbol 
since the distance d^oiM, in this spaqe is the limit of the distances 
dpiM, N) as p approaches infinity. - , ' 

Figure 4.4 depicts Ip spheres (all 
p i ^ having the same center M) for various 
values of p. The Ip metric spaces arc also 
called Minkowski spaces. In chapter 7 
.p=oo gj^ji examine multidimensional 
Minkowski spaces. 

We leave it to the reader to formulate 
a simple definition of line segment for Ip 
spaces. 

We can obtain an interesting class of 
metric spaces in the plane by defining 
distance as the minimum time required 
Pig. 4.4 to travel from M to N with some given 

restrictions on. the paths which may be 

taken. 

Making no restrictions, we can obtain the usual distance if the 
shortest path from A/ to is taken by a point moving with a constant 
velocity of one. 

We can obtain the metric space / if we require this point to move again 
with constant velocity but only algng line segments parallel to the 
coordinate axes. 

But we get a new example if (see fig. 4.5) we consider the map of the 
Moscow metropolitan area and suppose that a traveler may go from 
point M to point in the following manner. 




P>2 
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^ Fig. 45 

If the same subway station is the nearest one to both points, the 
shortest route is on foot. If this is not the case, the traveler wa{k$ (by 
the shortest route) to the station closest to the point of departure Af, ' 
rides by the shortest route to the station closest to the point jV, and from 
there mlks to N\ if two or more subway stations' are equally close to M 
or iV, the route for which the riding time will be least is chosen» Figure 4,5 
^hows two pairs of pointsr(A/, N) and (Af i, A^^; to go from MtoN one 
must walk, whereas to go from Mi to A^i one must t^ke a subway. Let 
us suppose that someone living between the Rizhskii and Botanic 
stations wants to go somewhere in the neighborhood of the Zemlyanii 
Val then it would be necessary to get on at the Botanic station and go 
to either the Lermontov station ojr the Kursk station. It is easy to see 
that the metric di{M, N) defined in this way is, in general, different from 
the usual geometric distance. In fact, if the point Q is situated near a 
heloport (either Dynamo or Aeroport), the point P near Volokolamskii 
Highway, and the point R near Valovaya Street (near the Paveletskii 
subway station) as in figure 4,5, then in the sense of ordinary distance 
the point P is somewhat closer to the point Q than is R: 

d{P,Q)<diQ,R). 

It is evident from figure 45, however, that 
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2S 



Actually, if one cannot take-a taxi, it is possible to travel from the 
hcloport tb Valovaya Street in less time than it takes to go from the 
heloport to Volokolaimkii Highway. 

^or the metric 4» Jpioin 1 (the axiom of symmetry) is nontriviaK 

The equality \ - ^ 

indicates that the time spent in going from Af.to N as quickly as possible 
is the same as that spent going from N to M. This is more of less true if 
one uses only the subway or travels only on foot. But if taxis are allowed, 

ahis is no longertrue; it is one thing to try to get a taxi at a taxi stand 
and an entirely different thing to try to get one in some remote neighbor- 
/hood or at the Kursk station wl\en the trains are coming in, 

v. Axioms 2 and 3 for the metric dt arc evident. The reader will have no 
tVouljle proving tjit triangle inequality (axiom 4) for himself if he 
recallsnhe proof of this axiom for the metric in chapter 3. 

In further investigation into the properties of metric spaces, it will be 
useful to introduce the concept of a Dirichkt region. Let £ be a metric 

. space and Li, L^,,,.,Li, points in E. We define the Dirichlet region of 
the point to be the set of all points N for which 



dm,N) ^diLj, N) 



(4.20) 



for all j 7^ /, and denote this set by A- In other words, the Dirichlet 
region is the set of points which are at least as close* to the point L| 
as to any of the other given points Ly It is clear that the Dirichlet region 
is determined by the choice of the points Lu ; - , ^nd of the given 
poirft Li. We shall now look at examples of Dirichlet regions in various 
metric spaces. 





Fig. 46 



Fig. 4.7 
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26 Some Examples of Metric Spaces ^ 

Let us first consider the plane with the usual metric and two points 
Lx and Z^. We join these points by the line segment LjLg (fig. 4.6) and 
draw a pcrpcndxcuiar through its midpoint. This perpendicular divides 
the plane into two closed half-planes, which are the Dirichlct regiogisJiHr 
the points Li and Z^. ' ^ * 

Let us now consider three points £i. La, and in the plane, again 
with the usual mctpic. In figure 4.7 we hav^ constructed the Dirichlet 
regions for these three points and marked them off with heavy lines. 
The method of construction is clear from the diagram. 

Let us now examine two points Li and in the plane with the metric 
fifi(Af, N) (that is, in the space /). For thi^kc of clarity, we shall again 
visualize a city divided into squares. Tm Dirichlet regions consist of 
those intersections from which the route through the city to Li will be 
shorter than that to and vice versa. These regions are marked off in 
figure 4.8 by a heavy line. Figure 4.9 shows the corresponding partition 
for the space C. We suggest that the reader try to derive the general rule 
for constructing the Dirichlet regions for n points in the spaces / and C 
by examining Dirichlct regions for two points and for three points. 




Fig. 4.8 Fig. 4.9 

Turning again to figure 4.5, we see that if we partition the space into 
Dirichlet regions for the pair of points P and R, then the point Q falls 
into the Dirichlet region of the point /?. We suggest that the reader draw 
this partition into Dirichlet regions. It is important to note that this 
partition differs greatly from those in figures 4.6, 4.8, and 4.9. 



5 The Space of 

Monnation* 



When we speak of communication^ wc usually mean some sort of 
f transmission of information. In this sense, communication appears in 
the form of books, letters, telegrams, musical pieces (recorded or 
written in musical notation), computer cards, signals directing the 
Sight and landing of space ships, mol^ules of deoxyribonucleic acid 
(DNA) .which transmit genetic infori^ation from parents to offspring, 
and so on. y 

Questions concerning the transmission and codification of informa- 
tion are examined in the theory of information.^ In the study of this 
theory, methods for determining the "quantity of information** con- 
tained in a given message are developed ; this ** quantity*' can itself be 
encoded as information. We frequently encounter this situation in our 
daily lives; in composing a telegram wc try to use the minimum number 
of words possible without destroying the meaning (that is, while 
. preserving the quantity of information). 

The revefse situation arises when, in an examination or in a seminar, 
a poorly prepared student amplifies his message, trying to express the 
small amount of information which he has on his topic in a sufficiently 
impressive quantity of words. 

A surplus of communication relative to the quantity of information to 
be transmitted is, however, not always harmful. Such redundancy can 
be useful when interference arises in the transmission of information. 

For example, when wc have a bad connection on the telephone, we 
are forced to repeat individual words. In conveying strange or difficult 

L A good reference for an account of information theory is A. M. Yaglom and 
I. M. Y^t^;Vtimyatm>st' i informatsiya [Probability and InformationH Moscow: 
State hibtishiilg iibusc of Physics and Mathenrmtics Literature, A transla- 

tion of this work will be included in the Survey of Recent East European Mathe- * 
nwtical Literature of the University of Chicago. 
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names, we use the following alphabetical device: In communicating the 
name •*P^Ysikakii" over the telephone, for example, we might say, 
Peter, Anne, VictoV, Susan, Irene, Karen, Albert, Kay, Ivan, Ida/' 
In this chapter and in tbe next we shall study methods of error- 
stabilizing codification of information, , without concerning ourselves 
with specific questions relating to the theory of information, ^n other 
wards, we shall study methods of writing down messages that allow us 
to correct automatically any errors that arise, provided that they are not 
too numerous. These methods are closely connected with the question 
"^of the possibility of defining a metric on the so-called spac^^of in- 
formation. . 

The idea of these methods is something we make use of frequently in 
everyday life— for instance, in reading boqks witlji printing errors and 
receiving telegrams with mistakes. If we read the word "§auc« pin'* in 
a book, we need not look in any "dictipriary of mistakes" in order to 
guess its meaning, There is very little chance that the authoV meant the 
word telegraph'^ here. For if he did, we'w^uld be dealing with eight 
misprints in a row, whereas if tlie word "sauc^ pan" was meant, there 
would be only one misprint,^ - ^^n. 



Still, there are curious examples where a totally different word can 
arise from a mistake in only oneJetter. For example, the Russian word 
korona ' * crown ' *) could be mStakenly written as " korova " co w ") 
or as '*vorona" O'crow'*). 

Indeed, a well-known anecdote is based on this situation. A Russian 
provincial newspaper is said to have printed this sentence in an article 
about the coronation of Nicholas II; **The Metropolitan placed the 
crow on His Highnesses head/' The next day a correction was published: 
"The Metropolitan placed the cow on His Highness's head." 

Clearly, even here it is quite easy to determine the true meaning of the 
message from the context. 

Analogously, a misprint ifi a musical composition can frequently be 
discovered because of its false sound and can be corrected by the laws 
of harmony. , ^ 

One must mention that errors can arise not only in transmission of 
information, but also during its storage, for example, in the memory of 
an electronic computer. The problem of discovering the correct message 
is the same for errors occurring during the storage of the message as for 
those arising during transmission. 

Every type of message^is written with the ^id of some set of symbols. 
The set of symbols used forms an alphabet ^. We assume that this 

2. Of course, sometimes there are more probable strings of misprints* arising 
from a typist's or typesetter's misunderstanding of the sense of certain words. 
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alphabet is given bcforchanii and consists of a finite number of symbols. 
For example, the alphabet might consist of all Russian letters, a space, 
and punctuatioYi marks. Using this alphabet, it is possible to write^any 
arbitrary Russian sentence. Another example of an alphabet is the set 
of all decimal digits, algebraic symbols, punctuation marks, and Latin 
and Greek letters. Using such an alphabet^ne write down the most 
divcfsc of mathematical formulas. 
Still another example is the binary alphabct—a set of two symbols, 
= {0, 1}. Using such an alphabet, we can write any number in the 
binary system. 

It is easily verified that any whole number x can be written in the 
form 

X = e^T" + E^^^l^-^ + • • • + 15^2 + , (5.1) 

where the quantities take on a value of 0 or 1. 

Thus, to transmit information about an integer it suffices to trans- 
mit a finite sequence of symbols of the alphabet 2I2: c^, e^-i, . . «x, «o. 
In order to separate the information about two different numbers, it is 
necessary, cither to introduce a special symlx)! for the end of a number 
or to transmit only sequences of some standard length.^ 

The latter method is the one actually used on computers, where the 
binary sequences to be stored in m^ory usually have a standard length 
corresponding to the number of memory cells'* available jn the 
machine. In computers now being manufactured, however, tkis principle 
is being departed from more and more, with memories of variable 
length being used. < 

Formula (5,1) is analogous to the well-known formula 

X - a,10^ + fin-ilO^"' + • • • + SilO + Go , (5.2) 

where a^, fln-u • • m ^1, ^0 are the digits in the decimal representation of 
the number x. It is easy to generalize equality ^(5. 1) to numbers whfch 
are not integers exactly as is done for decimal fractions. 

Let us determine the connection between the number n and the value 
of X in (5.1). Clearly, if the leading coefficient is equal to zero, the leading 
term can be discatded; this process can be carried out repeatedly until 

3. There are more complicated methods for separating the meaningful units 
(words) in an arbitrary alphabet. See, for example, the article by A. A. Sardinas 
and George Patterson in Kiberneticheskii sbornik [Journal of Cybernetics], no. 3, 
Moscow, 1961. 
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=^ 1. Switchiog all tenns except the first, from the right side to the 
left, we get 

X - is,|.i2Vi - «m-a2*^^ fii2^ - £q «,2* = 2* • 

This makes it clear that 

or 

/i ^ logs X • (5.3) 
On the other hand, the following inequality holds : 

e,2* + ir,_i2"-V+ e,-32»-'' + • • • + ei2^ + Cq 

^ 2» + 2"-^ + 2»-=» + • • • + 2^ + 1 t= 2"*^ - 1 . 
From this relation and from (5.1). it follows that 

X :S 2**^- 1 

or 

which can also be written 

n + 1 > logaX . , '''(5.4) 

Combining (5.3) and (5.4), wc obtain the inequality 
^ n <, iogaJC < n -f- 1 . (5.5) 

^e inequality (5.5) can be written as 

n = [loga x] , 

that is, n is equal to the greatest integer in !og2 The above statement 
leads us to conclude that the number of binary symbols required to 
code ail integers in the range 0 ^ ;c S ^ is 

I + Pogafl] = 1^^ (5.6) 

4. By the greatest integer in the number a we m^^^the largest integer which Is 
less than or ^ual to a. The greatest integer in a is witten [a]; for example. 
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The one is included here because th^ artri + I fcrms is the s«iuencc ^ 

With the aid of the binary talphabet 21,, any type of information ; 
(numbers, commands, logical relations, and so forth) can lie written 
into the memories of computers.^ j ^ 

By a message in a given alphabet ^ we shall mean a finite scepjcricc of 
symbols from this alphabet. It is sometimes conve;iicnt to divide a ^ 
messa^ into standard submessagcs, 4hich arc called words. 

Generally speaking, it is possible to define infinite alpWbcts and 
messages, but we shall not consider them here. 

A m^sage written in one alphabet can sometimes be translated into 
another. For example, as we have already seen, an inf^r represented 
by its decimal digits can also be written in the binary alphabet. One of 
the important examples of such translation is the following: Suppose 
that we are given an alphabet 91. We define a new alphabet 31' to be the . 
set of all words of iMgth less than or equal to some positive integer k 
which can be fomiiW using alphabet 21. It is clear that every message in 
alphabet 21 can be broken up ifito a sequence of words of length not 
greater than it, which means that it can be recoded in the new alphabet 
91'. ^ 

similar idea could be introduced for messages in the Russian 
language, written in the Russian alphabet supp^ented by a space and 
punctuation marks. Here it would be necessary to take a complete word 
list of the Russian language and to assign to each word in it a hieroglyph'' 
(using, for eS^pie, a combination of Chinese and Egyptian writing). 
If one could, ijviddition, introduce hieroglyphs in such a way that it 
would be possible to distinguish cases and conjugations of verbs, then 
one could recodc any message in the Russian language. 

In place of hieroglyphs one might use decimal numbers of six digits. 
The first five digits of such numbers would suffice for coding words ;^ 
the &ixth digit could be used for coding grammatical signs. 

Here we have for tK5^rst time stumbled upon the important notion 
of coding ajjid receding i^essages. By codification we mean, generally 
speaking, the formation in a given alphabet of messages containing 
given information or the translation of a mes^sage written in one alpha- 
bet into a message written in another. In this respect, "one-to-one'* 
translations, that is, cases in , which it is possible to transform the 
information of a message from one language to another in an essentially 
unique way, are of most interest. It is easy to see that the translation of 

5. On this point, see Donald F. Knuth, The Art of Computer Programming, 
vol. 1 (Reading, Mass.: Addison^Weslcy, 1969), 

6. As one could easily make do with a vocabulary of 100,000 Russian words. 
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Russian sentence from the alphabetical to the hieroglyphic form has 
this property. ^ 

In practice, this method of encoding messages by words is used along 
with a method of decoding by mians of a word alphabet. 

The reverse situation also (M:curs, in which a symbol from a given 
alphiabet $1 is coded in the form* of a word written in a^impler alphabet 
2t'. For example, suppose an alphabet consists of thr^ symbols , - , ♦} 
(dot, dash, end of letter). Then an arbitrary letter ^r punctuation mark 
can be written in this Morse code (see table 5.1) as a word of at most 
seven symbols from the alphabet ^\ ♦ 

Table 5 J 
The Morse Alphabet 
. i 

Morse Latin Morse , Latin Letters 

Symbols Letters Symbols (and Arabic Numerals) 



A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

M 
N 
O 

. P 

Q 
R 
S 
T 
U 



■4' 



V 

w 

X 
Y 
Z 

I 
2 

3 ' » 

4 . 
5 

6 

9 
0 

, (comma) 
, (period) 
; (semicolon) ^ 
: (colon) 

? (question mark) 
! (exclamation point) 



The marks and for the end of a letter and the end of a 
word, respectively, are coded by intervals of time and, therefore, 
are not racliKlcd*hrthe table. ^ 



In this w!iy, English words can be written in the Morse alphabet 
instead of tKeXatin alphabet. 
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Example. The English sentence, "What is distance?** can be written 
as follows in the Morse alphabet: 

— .♦.*. 

As it happens (fortunately for computer technology), any message in 
an arbitrary finite alphabet can be rccoded in the binary alphabet 
21, = {0,1}. 

^ Any nonnegative integer can be represented in the form of equation 
(5.1); that is, in the binary system and, therefore, as a word in the 
binary alphabet. 

If we consider only integers in some range 0 ^ x ^ flf, the sequence 
of binary symbols for x ^ • ei^o can have no morq than 

1 + [logs a] terms (5.6). 

Now, if we have an arbitrary finite alphabet 21 consisting of m 
symbols, ye can assign to each symbol an integer between 0 and m — I 
inclusive. And so, to each symbol of the alphabet SI it is possible to 
assign a binary word, corresponding, in accordance wjth (5.1), to the 
number associated with that symbol. Moreover, it is possible to make 
do with words of length where 

logs (m - 1) < fi ^ .1 + logs (m- I). (5,7) 

In this way it is possible in the case of any finite alphabet to limit 
oneself to words in the binary alphabet. Modern telegraphy employs an 
international telegraphic code for Russian and Latin letters, numerals, 
and punctuation marks. As an example, we introduce in table 5.2 the 
five-symbol code used in telegraphic apparatus of type CT-35.''^ 

The last five combinations are read in the ^me way in all registers. . 

The symbols of the registers indicate that after the appearance of, let 
us say, the symbols of the Latin register, all binary five-symbol com- 
binations are read as Latin letters. In order to switch to Russian letters, 
one must insert the symbol for thfe, Russian register. 

Example. Let us write the following sentence in our telegraph code: 
**The name Shakespeare is written JIIeKcnup in Russian.'* 

7. At present the so-called "international telegraphic code No. 2" is being used 
more and more. The following codefa variation of the 'International telegraph al- 
phabet No.l" for multiplex systenis, is based on an analogous principle. 

% 
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00001 

10001 
10000 
04100 
01 000 
01111 

oooiir 



10101 
00101 
00111 
10101 
10011 
10001 
00101 



Space of Moimation 

IIOIO.OIOOO 10001 01 111 lOOOO^OII OlOOo' 

UOlO" 10000 10011 01000 00101 11000 01000 

01000 10001 onoo ooioi loooi oiioi ooiii 

10101 01000 0111| 10001 OQOlO 01100 Hill 

00101 lldoo 01100 00111 10001 00001 01100 

00111 10100 00101 00101 01100 10000 Oti^l 



Table 5.2 

Interaaiioaa! TeUgraphlc Code for Russian and 
Latin Lttttrs 



Latin Numerical Russian Code 
Register Register Raster Combination 



A 


1 


A 


' 10000 


B 


8 


E 


00110 




— ? 


B 


01101 




V^.- 7 


ri 


01010 


D 


^ 0 


a' 


11110 


E 


2 


E 


01000 


V 


ff 




11101 


2 




3 


11001 


I 


III 


H 


OIIOO 


J 


6 ^ 


.ft 


lOOIO 


K 


( 


K 


10011 


L 




JI 


IIOII 


M 


) 


M 


01011 


N 


K) 


H 


OllH ^ 


O 


5. 


0 


11100 


P 




II 


11000 


R 




P 


ooni 


S 


« 


c 


00101 


T 




T 


10101 


U 


4 


y 


10100 


F 


3 


o 


OHIO 


H 


' + 


X 


IIOIO 


C 


9 


u 


10110 


Q 




m 


ipni 


X 


> 




01001 


Y 


3 




00100 






H 


00011 




Russian Register 




mil 




Numerical Register 




00010 




Latin Register 




00001 




blank 




1000! 




bcli 




00000 



Space oflitfarmaiion 



In the (xxted text the symbols for the registers arc in heavy print, for 
it is necessary to notice them in order to be able to chaligc from Russian 
to English, to arrange the punctuation marks, and to^wpitc down the"* 
letter "m/* The latter is plauced in the numerical registof dncc there are 
more Russian than Latin letters. X 

A five-digit binary code suffices for the represeamtion of^ Latin (or 
Russian) letters* Such a cade is given in table 5.7. 

TabkSJ 



a 00000 


h 00111 


o 


OHIO 


u 10100 ^ 


b 00001 


i 01000 


P 


01111 


V lOIOl 


c OOOIO 


j 01001 


q 


10000 


w 10110 


d OOOU 


k 01010 


r 


10001 


X 10111 


e 00100 


1 01011 


s 


lOOlO 


y llOOO 


f 00101 


mOUOO ■ 


t 


10011 


z 11001 


goolio 


n 01101 









The sentence " The length of the hypotenuse is less than the sura of the 
lengths of the twoJcgs" can be coded as follows: ^ 



1001! 


00111 


00100 


11010 


01011 


00100 


01101 


OOHO 


10011 


coin 


11010 


OHIO 


ooioi 


11010 


10011 


0011 b 


OOIOO 


HOlO 


ooni 


11000 


01111 


OHIO 


"^0011 


00100 


OIlOl 


10100 


lOOlO 


00100 


11010 


01000 


10010 


>1010 


0101 1 


00100 


10010 


10010 


11010 


loon 


00111 


00000 


OHO! 


IIOK) 


10011 


00111 


OOIOO 


11010 


10010 


10100 


01 100 


11010 


OHIO 


00101 


11010 


10011 


coin 


OOiOO 


11010 


01011 


OOlOO 


01101 


OOHO 


10011 


OOlll 


10010 


11010 


OHIO 


00101 


nolo 


icon 


00111 


OOIOO 


11010 


10011 


101 lOf 


OHIO 


11010 


OlOH 


00100 


OOHO 


10010 





Note that the separation of the five-digit strings is usc^ here only for 
ease of reading and that the blank entry 11010 has b^n introduced 
as a space symbol between words. For storage of such a message in the 
^ memory of a computer or for transmission by means of telegraph, no 
symbols but zero and one are needed. 

To illustrate this point, let us suppose that the above text were written 
as a cofttinuous string of zeros and ones. Then the first line (excluding 
space symbols) would read: 

10011001 nooioooioiiooioom^^ 

We could initially separate the first five symbols 10011 and write 
them down- Theiuwe could separate the immediately following^ five* 
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w 

symbols 001 1 1 and" write them down. In this way we could generate the 

complete message by inserting spaces between strings (on the subject of 

separating words in messages, see note 3 on page 29). 

We shall now introduce the idea of a space of communication. Let us 

cpnsider an arbitrary alphabet^ S and the set of messages consisting of 

exactly n symbols from th^ alphabet % 

We define the distance d{i, t}) between two messages ^ aiad to be the 

-nujTiber of positions, in which the messages $ and r) have different 

symbo^^s. The metric space E{n,^) obtained in this way is called the 

/2-dimensional space of communication over the alphabet S» 

if ' ' , 

Example It^is the Latin alphabet, « = 5. Let ^ = build ; r] = guilt. 
All letters bin the first and fifth coincide, and so d{^, ^) 2. 

£jcam/?/£Z'*2l2 is the binary alphabet, w - I2andf - 0001 lOlOlOlO; 
7} == 010101 101011. The second, fifth, sixth, and' twelfth binary digits 
do not coincide, and so d{^ 7]) — 4, 

JMote^that it is possible to compare any words of lengthy not greater 
than n if it is agr^d that w£q;ds of less than n letters are augmented by a 
previously chosenietter 'until they are of length/? {usually 0 in the binary 
alpha^t). ^ 

Let us verify that the metric d define4 above satisfies all of the 
necessary axioms. 

The a;i^iom of symmetry d{^, y]) d{7], i) follows from the definition, 
in which the roles of ^ andV^^i^^^^^h^^g^^^t^le. It is* obvious that 
d{i, rj) > 0, and that d(^, ^) = 0 only if all of the corresponding symbols 
in the messages i and rj coincide — that is, if the words ^ and y] are4he 
same. 

The triangle inequality is verified as follows: Assume that we are 
given three words ^, r), and C of length n. Let us suppose that in the A:th 
position, the symbols of words i and ^ coincide, as well as the symbols 
of words C and 7;. Therr it is clear that for this position the symbols of 
words i and yj also coincide. 

To be concise, let be the A'th symbol of message i\ the kih 
symbol of message and the kih symbol of message rj. Then if 
- and ^ Vki L ^ Vk' Taking the contrapositive, if f- rj^, 
then either ^ C;, or 4 7^ Vk- 

Thus, words i and t] can have different symbols only in those positions 
where either the symbols of words i and ^ or those of words ^ and yj do 
not coincide. This indicates that the number of symbols of ^ and ^ 
which di*Wr does r^ot exceed the sum of the number of noncoincident 

8. In this situation it is not even essential that the alphabet 21 be finite. 
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symbols of f and t and those of ^ and jj. Byt the number of symbols at 
which f and 1 do not coincide plus the number at which C and i? do not 
coincide is </(^, 0 + </(^, In other wor^s, 

di^,i)^dU,^ + dii,yi), (5.8)^ 
the triangle inequality. 

Expmple. In the space £(5, S), where a is the Latin alphabet, let 
i = trace, r; = truce, and C - trUnk. Clearly. di$, v) ^ U d{^, 0 = 3, 
and dii, n) = 2; and so 

» ■ • 

With the aid of this metric, it is possible to formulate a general 
principle for the construction of codes which allows us to correct 
mistakes automatically. This principle was first introduced by P. 
Hemming.® We shall examine it in the following chapter. 

9. See the article by P. Hemming in the collected translations Kody s obna- 
ruzheniem i ispravleniem oshibok (Codes and the Detection and Correction of 
Errors), IL, Moscow, 1956. 
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Automatic 
Correctioii of 
Errors in 
Message 



In this chapter we shall examine the space of ^'"^""^f 
that is, the s^ce of messages of length n fo««ed m the alphabet ^ 
Sve aif^y seen, it is possible to limit oneself exclusively to bmary 
Tes^gts Tes^ges i^ the Sphabet ^. All of our interesting examples 
will come from this alphabet. / . ^ 

LcTus consider the following genera! scheme for fl,e t«"»™3» °f 
infermation (fig. 6.1). Messages emanating from some sojitce are 
^™Tnto an error-stabilizing code by means of a coding deme. 
^the:^ messages are transmitted ^.-g -^^^^ 
which time the messages might become distorted. Fraally, the 
Tre corrected at the receiving end by a decoding dev.ce and decoded mto 
the initial code if necessary. 
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Fig. 6.1 



The automatic detection and correction of errors during the storage 
of^atTon in machine memory occurs in a completely analogous 

^information is stored in the memory, it is translated into an error- 
J^^^ When the message is read, the correspondmg decodmg 
I^^Sl^g with the correction of errors admitted during storage. 
By ;et<li;^r^^^ decoding^ ^rrecting, recoding, and stonng 
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information, we can be sure of its atxuracy. In particular, if we choose 
a p^od of time T during which not too many distortions of the stored 
infofmation c^n arise, and repeat the above process no less frequently 
than once per period Tof time, the accuracy of the stored information 
will be guaranteed. In other words,. 7* muat be Chosen so small that the 
distance d{(, i') between the stored message f and the message that 
is read cannot become too^reat. « 

We now choose a subset of E(n^ 21) with the property that for any 
two distinct elements f'and ^ of iV^, , 

1 d(€.7])^k. (6.1) 

We shall call the set N^^ the set of intelligible words. Let us suppose 
that during the transmission and storage of the intelligible word $ e 7V^, 
/ errors (with I <^ k — 1) are" admitted—that is, / symbols of the word 
^ are incorrectly given. This incorrectly transmitted word we shall 
denote as f. By the definition of our metric, d{^, /, Clearly, the 
word ^' is not intelligible, for if it were, d(i, f') would be greater than 
/—by (6.1). 

Thus, we may check the transmitted word ^' and see that it is not 
intelligibie (it can, for example, be compared with all the words of A^^^ — 
in figures 6.1 and 6.2 this possibility is guaranteed by the availability of 
a dictionary). We would then discover that an error had been made. 
While the word is in the machine memory, such a process of checking 
can take place periodically, where we choose the period Tto satisfy the 
condition that during the time T there is little chance for more than 
k — 1 errors to ari^ in a single-word. Thus, we already have a general 
principle for the detection of errors. 
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But we can do even more; \ve can actually correct the mistakes that 
arise. For this purpose^ we shall assume that the number of mistakes 
1 S {k - l)/2. Let ^ be an arbitrary intelligible word ^^sstinct from ^, 
and I' as before, an incorrectly transmitted word. 

Applying the triangle inequality, 

Setting n = ^ and using (6.1), 
From this it is clear that 

die^Tj) > k ^ I > k --J^ ^^^^ (6.2) 

since I ^ {k - l)/2. 

From the assumption that / < - l)/2 and from (6.2), we conclude 
that the incorrect word f is at most {k — l)/2 away from the correct 
word I and at least as far as {k + l)/2 from any other intelligitJle word 
7). In other words, we find that the intelligible word i is nearest to i\ 
and thus establish the correct message. 

The above discussion seems to suggest the usefulness of determining 
the Dirichlet region of each intelligible word. For each word f to be 
corrected, it must be determined to which Dirichlet region the message 
belongs. The intelligible word determining this Dirichlet -region is 
considered the correct word. 

Here is where Hemming's remarkable idea comes in. This idea is 
ba^ed on the fact that for the purposes of transmission, one need not 
use all possible combinations of symbols from the alphabet, but only 
some set of intelligible words. Since in English only certain combinations 
of letters are used as intelligible words, the sense of distorted words can 
frequently be established without the use of additional codings. This has 
already been illustrated. 

We shall now *^amine the means by which error-stabilizing codes arc 
constructed in practice; in particular, the construction of sets of 
intelligible words N^, ^ 31). All of our examples will come from, 
the binary alphabet ^i2« As we have already seen, such a condition is not 
a limitation, for itj is possible to write any message in the binary^ 
alphabet* 



Automatic Correction of Errors in Messages 



41 



The problem of crror-stabiiizing codification can be formulated in 
the following way. Suppose that we have the space of 5-symboi bihary 
messages £(5, We must place in correspondence with each such 
message a rjiessage from^omc set Nf^ ^ E(n, Sla). This set of intelligible 
words iVjfe must be stable'^ith respect to /-place errors. We shall call the 
quantity {n — s)ln the redundancy of the code. 

Since the exact formulation of this problem must involve the probable 
distortion oa:urrin^ during transmission, it is necessary to construct the 
code (the set N^^ c gt^)) in such a w^y that the probability of 
receiving more than / errors in a word of length n is sufficiently small. 
This more complete formulation of the problem is studio in informa- 
tion theory, but it need not concern us here. 

In the construction of these codes it is especially convenient to 
introduce and apply the concept of addition modulo 2\ that is, according ' 
to the rules 

0©0-0, 1©0=1, 
'001-1, 1 @ h = 0. 

^ The circled plus sign indicates that the operation carried put is not 
. ordinary addition. The djj|tance between two binary words ^ = 
XiX2 - ' 'Xn and 7^ = jij^a* • -yn (where all Xi and yi have the value 0 or 1) 
can now be written in the following way: 

d{L v) ^- i^i ®yi) + ® ^2) + ' - + ix^®yn) ^ 

Since ones will appear as terms in this sum when and only when 
corresponding symbols differ, the^total will be exactly equal to the 
defined distance d{i^ t)). * 

Let us consider the space of messages E{n, 2I2) ^nd associate with 

each word i ^ E{s, ^2) ^ word of length 5 -h 1, formed according to 

the following rule: The first 5 symbols of the word f ' will be the same as 

those of the word f The last {(s + 1 )'^) symbol of the word is chosen 

in such a way'as to make the sum (ordinary) of binary symbols in the* 

word I' even. In other words, if T - X1X2' • 
« 

Xi©X2©' ©.x,®x„, =0. • (6.3) 

This equality (and some easily verified properties of addition modulo 2) 
aiiow us to express Xg+i explicitly; , . 

x,+i = ®X2®- ■ -©x,. ^ (6.4) 
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For example, if f - 001011101, then f - 05l01 11011. 
The words ^' formed in this way define the set of intelligible words 

N2 G E(s 4- 1, 

It is clear that the distance between two distinct intelligible words 
and must t^even, for if differed from T in an^odd number of 
positions, then the sum of the units in one of the words or would ht 
odd, a situation made impossible by the construction of these words. 
And because the smallest even number not equal to zero is two, the 
minimum distance between distinct intelligible words is two; thus the 
subscript 2 is used. 
^ Consequently, this code allows us to detect errors of one digit by 
counting the nonzero digits ; if the evenness criterion (6.3) is not satisfied, 
then the word contains an error. This error detection process is widely 
known as the evenness test and is very frequently applied because of its 
simplicity. The redundancy of the error detection code is 

{s + 1) ^ ^ ' 1 , 

We shall now consider a beautiful example of a code (due to 
Hemming) which is capable of correcting single-digit errors. 

Let f ^ E(s, 2I2) be a binary word of length 5. We form the word 
I' e E{n, 2I3) according to the following rule: Among the n positions in 
the word we choose the fitst, the second, the fourth, . , . , the (2^)th 
, positions for controlling symbols which are determined by the word 
Between these positions are the significant positions. In the example 

f - lOOllIOOlOOIIOllUllOllOOOIOOlO, 

we have indicated the mutual distribution *of the controlling (dis- 
tinguished by heavy type) 'and the significant positions for the case 
s - 2b, n - k - 4. In order to make s significant positions avail- 
able, the number of controlling positions {k + 1) plus the number ^f 
significant positions must lie between the kXh and {k + 1)'^ powers of 
2; that is, it is necessary and suffipienl that 

2' <s + k + \ < 2^^' . (6.5) 

The redundancy of the given code is [{s + k + I) - s]ls + /c + 1 — 
{k + \)lis+ k+ I). 

The (1 + 1)'^ controlling position (position 2*) is filled according to 
the following rule: Each position of the word ^' is defined by a number 
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/, counting from, the l^ginning of the word. We C5»nrinc the binary 
representation of this number: 

—the number of binary elements in the represcntition of the number / 
is defined so that, in accordance with ($.5), / < 2*^^^ . r 

Let us now consider the set tt^ of all ^hose positions / for which A = 1 . 
This set contains exactly one controlling position, the position with the 
number / = 2^ We fill thi «iQ§ij ^n in such a way that the sum of all the 
^nes in the positions of ttj will be even. 

In table 6.1 we give an example of a word |\ which can be read 
vertically in the second column. We have shown the binary number of 
the positions and marked wi\l} a star those positions belonging to the 
set TTj. Words ^' constructed according to this rule shall be called 
intelligible. 

We shall show that the distance between any two intelligible words 
I' and 7]' is not less than 3~that is, that the intelligible words form a set 
Ns^ E(s + k + l,^,. 

Case L Suppose words i and i? from E{s, differ in at least three 
positions. Clearly, then, the words |' and likewise differ in at least 
three positions and, consequently, d{^\ ^ 3. 

Case 2, Let the words i and 7} differ in two positions. Then the words 
I' and 7}' differ in two significant positions — say positions l^nd l\ 
Since / ?^ /', the binary representation of / differs from thai of V in at 
least one place. Let / be the place in which the two representations differ 
and, without loss of generality, say /i = 1 and // = 0. Then / e tt^, bat 

Because the words ^' and\' differ in only two significant positions, 
and since /' ^ tt^, the sum of the significant digits in for the word ^' 
and the sum of digits in the corrcspohding set for t)' must differ. As the 
sum of the digits in the set of positions ir^ must be made^even both for 
f ' and for t]\ the words |' and t]' must differ again in the controlling 
position of the set (in position 2^. Thus, and ^/kiiffer in at least 
three positions, and d(i\ t]') > 3. 

Case 3. l^et the words i and t] differ in exactly one p4)sition. Then' 
the words and t]' differ in exactly one significant position with the 
number /. This number cannot be a power of two, since numbers of the ^ 
-iform 2* are used for the controlling positions. Therefore, the number / 
has at least two nonzero binary digits = I and = 1 . Consequently, 
position / is in both and tt^. Since the sum of the digits in these sets 
must be made even for both and 7)\ f and t]' must differ in controlling 
positions 2* and 2^, 
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In each case, then, the words f and differ in at least three positions, 
and d{i\ 7?') > 3. 

And so the set of intelligible niessages is an ^3 set; consequently, one 
can in l^incipie restore distorted messages even if the error occurs only 
in a single digit. 

In the binary case, this process of restoraUon can be carried out with 
comparative ease, for to restore a word in the binary alphabet, it is 
sufficient tff determine the number of the position in which the error 
has occurred and to change the entry in this position from 0 to I or 
vice versa* v ' 
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In the code that wc are examining, the number of the position with an 
incorrect entry can be ascertained by the following method: After the 
transmission of the message i\ during which only one digit can be 
distorted (resulting in the message we check whether the sum of the 
digits is even or odd for each set of positions n^. In other words, wc 
calculate the controlling quantities . . . i 

♦ • . ' 

where is equal to the sum modulo 2 of all the symbols in the positions 
of the set tt^ of the received message 

If ail of the = 0, then i* is an intelligible message.^ If, however, 
some cci = 1 , then an error must exist in a position / belonging to the set 
TTi, that is, in a position where the /th binary digit is equal to K Con- 
Versely, for each « 0, no error occurs in any position belonging to 
the set rr^ (since two errors that cancel each other out are extremely 
improbable). 

Thus, the controlling quantities arc just the binary digits in^e 
expansion of the number of the position in which the error has ocoUrred; 
that is, 

l^a^l^-^a^^.l^-^+'-i-a^Z+ao^ (6.6) 

So the controlling quantities of the received' message completely 
determine / and enable us to restore the correct message ^\ 

Let us take, for o^ample, the word i' written in table 6 and distort it 
in the nineteenth position. 

We obtain the word 

^* = lOOUlOOlOOlIOllOlOiOIlOOOlOOiO; 

carrying out pur test, we find 

- ^ 1 , ^3 = 0 J «3 0 > «i = 1 > ^ ao — I , 

that is, / = 1001 1, the binary representation of the decimal number 19. 
Changing 0 to I in the nineteenth position of the word we obtain 
the Word that we started with. 

1. That is, if an error exists, it is an error of at least three positions, a situation 
made impossible by the fact that the transmission time is so short that it is highly 
improbaisle for more than one error to occur. 
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A simpler code allowing us to correct single mistakes would result if 
th^'^word r were given by a triple repetition of the word f e £(5, Sia). 
Then if i and 7} differ in r positions, the corresponding words f ' and ij' 
would differ in 3r positions. Thus, d(i\ 1?') > 3, provided that f ^ 7)\ 
Tile transmitted word is checked in the following nlanner. ^ 

A triple of, positions with the numbers /, / + 5, / + 2s, where 1 < 
/ ^ 5, ^s considered. If the symbols in these^ positions coincide, the 
corresponding symlK)} is considered to have been given correctly. Since 
the binary language contains only two letters, the symbols in two of 
these thr^ positions must coincide; and so, if only two of these symbols 
coincide, their- common meaning is cqnsidered to be the correct one 
and is entered in the third position. ^ 

Thus, this code is capable of correcting single errors in each triple of 
correspon^g positions. The weakness of the code is its high re- 
dundancy, which is (35 — ^)/3^ 2sj3s -=''2/3. The redundancy of the 
former code is 

k + V [logaC^^ ^ + 1)3 + 1 
s + k I ' s + k + \ 

♦ 

where the square brackets denote the greatest integer function (since 
2^.^ + k + \ < 2^^\); setting the length of the word (s + k + I) 
equal to nl the redundancy becomes {[loga n] + l}//i, which, for large n 
(long ivords) is practically zero. ^ ^ 

Codes that allow the correction 01 errors in the transmission and 
storage of information are very important in various automatic control 
devices. The last twenty years have seen the appearance of a great 
number of y/orks concerning error-stabilizing codes that allow us to ' 
correct multiple as well as single errors. 
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In this chagter we examine an n-dimensional vectca^pace R" and 
various distance functions which determine metric spaaS>^Ilicj^«tor 
space serves as a gcMralization of the concepts of line (R^), plane 
{H% and three-space (R^lconsidered in element^ geometry. We can 
arrive at a reasonable definition of the /i-dimensional spac^ R* {n-space) 
in the following nianner. 

We consider the plane with some system of Cartesian coordinates. 
Each point M on the plane is uniquely defined by a pair of coordinates 
(x, y), where x e R, e R (here R denotes the set of real numbers). 

To each point M there corresponds in a one-to-one manner a vector 
joining the origin of the coordinate system to that point (see fig. 7.1). 
Thus, there exists a one-to-one correspondence between any two of the 
following objects: 

The point M ^-^ the vector OM <^ the 
pair of coordmates (x^y). Conse- 
quently, we may think of the pianc^ 
f^(^ y) interchangeably as a set of points, a set 

of vectors, or a set of ordered pairs 
(jc,7) of real numbers. Analogously, we 
"can consider three-space as a set of 
^ ordered triples (x, y, z) of real numbers. 
Fig. 7,1 Our desired definition' (of /hspace) 

suggests itself. 

By a vector in /i-spacc [U^) we mean an ordered /j-tuple of real 
numbers 

i = {Xif X29 • • • f Xj^) . 
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The numbers Xu ^2. ■ ■ m are called the coordinates of the Vector t 
The set of all such vectors is the n-dimensional vector space R*. 

Clearly, the vector space SS^ is ordinary three-space; the vector space 
is the plane; and the space is the straight line. 

Three operations are defined on vectors in addition, subtraction, 
and multiplication by a scalar (real number). These operations are 
defined as follows. 

The sum of the. vectors ^ - (x^, x^, . . and 7? {y^, y^, . ■ 
IS the vector. ' •■^-.^^ . ' 

the coordinates of whigh are the sums of the corresponding coordinates 
of I and 7^: • 

Analogously, the difference of these same vectors ^ and 7} is the vector 

.whose coordinates are the differences of the corresponding coordinates. 
* The product of the scalar a and the vector f (xi, x^, . , , , is the 
vector 

^ (p = ai ^axi, 0x2, . . oxj . 

In other words, to multiply a vector by a scalar, we jwultiply each o^ 
the coordinates by the scalar. On the plane and in three-space these 
operations have natural^geometrical intijrpretations. For the sake of 
clarity we shall examine two vectors, ^ and in the plane (fig. 7,2). 
From the diagram it is clear th^t the ^ = ^ + is the vector 
formed by the diagonal of the parinelogram determined by the vectors 
f and 77. This property of vector addition is useful in phyjical con- 
siderations involving sums of vector quantities such as forces and 
momenta. 




Fig. 7.2 



Fig. 7.3 
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'The difference of the vectors | ind (fig. l3) is the vector directed 
from the end of the vector t) to the end of the vector t 

The product of t^e positive number o and the vector t is a vector 
having the same direction as but of length c times the length of f 
/ (Clearly, when a < .1 , the length of the sector is less than that of the 
vector f ) To multiply the vector i by the negative number o, one must 
■."* . multiply it by and then take the vector with the same length but 
opposite direction. All of thsie cases are pictured in ^ure 7.4. 
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*6nt can easily verify that the operations on w-dimcnsional vectors 
defined above satisfy the following properties, which are al\alogous to 
the i>roperties of the corresponding operations defined on the real 
numbers. Here -r? e R" and a,beU. The symbol 0 is used to denote 
both the real number zero and the zero vector (0, 0, . . . , 0) e W. When 
0 is written as the sum or difference of vectors, the zero vector is denoted. 
All scaiars are written to the left of vectors in a scalar multiplication. 
\: ^ + = T) ■¥ ^ (commutativity), 

2. 1 + (tj + 0 =^ + 'j) + ^ (additive associativity), 

3. I - I = 0, / 

4. 0 + ^ = I, where 0 e W, 

5. + ri) ^ ai + 07] (distributivity of scalar multiplication over 
vector addition), 

6. ia + bU = + bi (distributivity of scalar multiplication over 
scalar a'ddition), , 

7. a(/?^^«M<^^)^ (multiplicative associativity), 

8. 0-1 = 0, where OeR, 

9. a O = 0, where Oe R", 

10. 1-1 = I. 
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Clearly, two vectors, | and ij, are equal if and only if ^ — , = 0. 

Let us coosider some other examples of multidimensional spaces 
that arise natTirally in geometry. 

EMimple L The set ,of all sphere's In thnee-space. Each sphere is 
uniquely determined by^^n ordl^red 4-tuple {x,y, z, R\ where {x,y, z) 
is the center and R the radius. 

Exmiple 2. The set of all trj/ngles in three-space. Each triangle is 
uniquely determined by an ordered 9-tuple (xi, x^, ja, z^, x^, y^, Zg),-^ 
where the triple yi, 2<) gives^ the coordinates of the /th vertex of the 
triangle (i = 1, 2, or 3). We suggest that the reader convince himself that 
in both of these examples multiplication of all of the coordinates (that 
is, of the corresponding four- or nine-dimensional vector) by the real 
number a is equivalent to performing a similarity transformation with 
the center of similarity at the origin. We further suggest that the reader 
make a^more detailed study of various possible metrics in the spaces of 
spheres and triangles. " 

Let us now examine various metrics which we can define on W to 
form a metric space. • ^ ^ 

The metric (determining the metric space l^^^^) is defined by- 

dM.l) V(x, - y^f + (X3 - ji^a)' + - • + (x« ^ y^^ (7.1) 

where 

^ ^ ^ - (^1, j^ca, and ^ {y^y^,- ^,yrd ^ 

In three-space and in the plane, the metric is just the ordinary 
geometric distance function. Properties 1, 2, and 3 are obvious for this 
metric. * ^ 

The space /i^**^ is defined by the metric dx where * 

>?) - \x, - .Vil + - J2I '+ - ' + k« - yn\ . (7.2) 

In the plane (the space A^^^ defined by tlie set and the metric d{) this 
metric coincides with the metric t/i defined in chapter 4. Again, p^per- 
tiesTT^ and 3 are obvious. 
The space C^"^ results if we define a metric d^ according to the rule 

dMj V) ' niax {\x, - • y^l - y^^], . ..,\x^ - y^\) , (7.3) 

that is, ^«>(^, 7)) is the maxima! cievi&tion of corresponding coordinates. 
Properties I, 2, and 3 are obviously satisfied by this metric also. For the 
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plane it coincides with the metric introduced in chapter 4. 
Let us prove the triangle inequality for the space /^^^^ 
Let ^ 

Then, obviously, 

= |Xi - Zi + Zi - )ul + IXa - + - J^al + ' • ' 
+ x„ - + z, - 

= </i(^.iD + <^i(C,i?), c 

and the triangle inequality holds. 

For the space C<"' with the metric d^^the triangle inequality is proved 
as follows. Let jx^ - yn] be the largest of the^differences of correspond- 
ing coordinates ; that is, 

.. </»(^, v) '"ax (jxi - j'll, 1^2 - ysl- ■ i^n - yn\) 

= \xh - yk\ = \xk - zic + 2^ ^1^1 

It is obvious that 

- j'fci < max ([zi - jza - y^], ■ . ■, k« - = <^<x,(C ]■ 

(7.5)^ 

, Combining (7.4) and (7.5), we get the desired relation 

A general class of metric spaces over W is obtamed if we mtroduce a 
metric defined by the formula 

</p(l, i) = ^(ATi - y,f + (X,, - ;'.)•' +■•■+, (X, - y^^ , 

where p > \ \ the'space obtained in this wjjy is called ■ 
"properties 1, 2, and 3 Ian be verified in this case exactly as before. 
The triangle inecjuaiity is derived frorrf* Minkowski's inequality (see the 
footnote on page 2\)x v ^ » * 

<^ifl, - hf + (02 - b^y + • • ■ + (a„ b^Y ^ 

S <. ^r^-^f\ . ■ • + On" + ' t b^^ . • + 6/ . 
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It is not diflicult to see that for /? = 1 and /? = 2 the spaces and 



(ft) 



ddilHti above are obtained. As ;? ^ oo the metric approaches the 



metnT^/^ '; that is, /oo^'*^ = C^**\ The reader can easily verify this by 
generalizing the analogous argument in chaptcr>4. 

A mpre difficult exercise is to show th^^t the sphere of'radius r in the 
space /i^^^ is an octahedron (fig. 7.5), whereas in the space is a cube, 
(fig. 7.6). ^ . ' ' 
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The spaces /^^"^ over iR\Jike the corresponding spaces Ip in the^^plane 
{W\ are called Minkowski spaces. These^spaces can be generalized very 
* naturally to an infinite-dimensional vector space whose elements are 
vectors Svitfi an infinite niimlDer of coordinates. 

A more general class of metrics on W can be defined with the 
introduCtipn of the concept of convex body. 

Let us introdud^vs^^al new defini- 
tibn^. We shall interpret a vector ^ in 
as the point correspondipe to the 
terminal point of tTfaf* vector when the 
'initial pofrU is placed at 'the origin. We 
i^ay that a subset V of W is convex if for 
each pair of vectors i e Kand r] ^ V, all 
vectors of the form a$ + {\ - a)7], 
where a is an arbitrary number between 
zero and one (0 < ^ < 1), arc. con- 
f^'jg' * ' tained in Geometric^Uly (in U'^ and 

R^), this mean&.t^at the entire line 
segment joining any two points x)f contaiaed irr V, 

A subset K c: is bounded if there e^jrSts a positive number A' such 
that for any ^ {xu Xa, . . . , xj e K, , 




s 
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Figure 7 J pictures a convex but.unbounded subset of K*; the suljset 
pictured in figure 7.8 is both convex and bounded. 

A vector | belonging to a subset V of R" is said to be an interior 
point of V if for each vector y] e [R\ there exists a positive number a sucji 
that I + arj e K. Irt other words, if we move in an arbitrary direction 
from the end of the vector 4, then we remain for some time in the set V. 

If K is a flat surface in U^, then V has no interior points. In fact (see 
fig. 1.%^, \f ieV and the vector tj is perpendicular to the plane in which 
Flies, then for any positjye a the vector | + OTj lies outside this plane 
'and, in particular, outsidef.the iset 

A subset of R" is said to-b^ full-dimensional if V has an interior 
point.-^ A convex, bounded, full-tfimeftsionai subset V of W will be 
called a convex body} 





■ Fig. 7.8 ^ig' '^•^ 

Let us now consider a convex body V symmetric with respect to the 
origin (that is, if | e then - 1 fi V) in which the origin is an interion 

point. . • ' 

Thi^ convex body can be used to define a metric dy on R^. Suppose 
T^rR^ let'^-'^-T/. Since the origin (0,0,..., 0) is an 
interior point of K there exists a positive number a for which t K It 
is easy to show that since V is bounded, there is an upper bound to 



{a I aC t-' V}, In oi\m words, there is a lower bound to (1/^ 1 V) 
At this point, we 



P^...., introduce the concept of greatest lower hound. If 
/I c: is bounded below, fhen the greatest lower bound of A (written 
inf ti) is the uniquf number b for which the following conditions are 

satisfied;^ 

L We leave it to the reackr to show that a convex body must havc-infinitely 
many ^interior points. - 

2. The question of the uniqueness and existence of the greatest iower bound is 
involved and need not concern us here. For a full discussion, see Waher Rudm, 
Frindples oj Mathematical Analysis (New York: McGraw-Hill, 1964). 



ERLC 




54 Metrics and Norms in Miiiti-dimensional Spaws 

-I. If fle^, then i :fi a; . 
2. If £? is a lower bound for A, then b. . 
We are now in a position to define tjpdistanc^ dy(^, rj) as the greatest 
Idwer bound of {l]a\ a > 0^ ate Recall that ^ = ^ _ that is, 

dr(i,4=inr^. (7.6) 

For S = 0, that is, when the vcctofs i and are equal, any a is admitted 
(as we ajjvays have fl{ = 0 e V), and the greatest lower bound in (7,6) 
is zero. When i and i? do not coincide, the vector Z ^ 0 and the per- 
missible values of a are bounded from above by some positive number 
A. Therefore, the values of 1/a are bounded below by I /A, so dy{i, rf) 
iiif ly^j > 0. In other words, if^ ¥^ r,, dy(i, tj) i| strictly greater than 
zerQ. ^ ' , > ' 

Because- the convex body Vis symmetric with respect to the origin, 
a^e Fif and only if -a^ = a(-^6 K.' Siilce ~C=='v ~ i, the 
symmfetr^f the metric is shown; |Jiat is, 

thus,* properties 1 , 2, ^nd 3 (page 12) hold for the metric dy. Only the 
triangle inequity r^ains to be shown. A 

Let ^, t;, and C be vectors R». We clioose^wo positive' numbers a 
and b such that a(| - 0 e F ao'd b{C--n)e V. Lefijs denote by a the 
quantity ' .,-4 



r 



Clearly, 0 < a < I and 1 - a Because Kis convex, the 

vector % ^ 

^? ^ a[a(^ (i a)[^(^ - yj)] I (7,7) 

is also contained in V, Transforifiing expression (7,7) byjjibstituting the 
values of a and I ^- a and using the properties of operatirniTift^^vectors, 
we get - y . r ' ' 

'r^b,<'~ot^b-'^^~^^ ^ 

wherJc = fli;/(fl -f 6). ' * - 
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*^ c . ab b a ^ ^ 

must be at least as great as the distance d^^i^ ^fj) (by the definition of 
<Wf»^)as inf I la): 
• % ■ 

^ ^^{f ^) ^^ + ^- . " (7,9) 

However, by the definition of the numbers a and b, the quantities 1/a 
and l/f? can be made arbitrarily close to the distances dy(^,0 and 
dviC-q), respectively, since 0 is the greatest lower bound of the 
1/a and dy{C^ t]) is the greatest lower bound of the I lb. And since the 
inequality is preserved in the limiting process, (7.9) fields the desired 
inequality • 

dy(Lv)^ Mi. 0 + dAC. V), (7.10) 

It is possible to develop the definition of the metric dy in several other 
ways. 

The norm of the vector the quantity 

mv-dy(i,0)= inf 1. (7.11) 

It i^ear that the distance dyd, r^) defined above is just the norm of 
the difierence of the vectors i and 17, that is, 

'M$,v)= U-llv (7.12)' 

It car) be shown (and we leaveihe prodf to the reader) that this norm 
satisfies the following properties for f f R", e R", a e R 

1. Uh > 0; . . 

2. ll^lv = 0 if and only if i = 0; 

■ 3. \\ai\\y - Wll^iv;, "■■ 

4. U + vWv < Ulv + i^llv 

It is possible to arrive at the concept of rtorm by a more abstract 
route. We define a norm on the ^-dimensional vector space R" as a 
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function U: R (where U^f denotes V{^) defined for each | e S5» 
in such a way that the foHowing properties are satisfied (here. ^ e R*, 
7j e K% a e ^ii—,^^ 
.1. lia/^O; 

2. i^l - 0 if and only if ^ = 0; 

3. lNll>=Willl; 

4. ii^ + ^i.^lfll + hi ■ . .. 

The vector space with a norm defined on it is called an n-dimen- 
sional Minkowski space.^ It can be shown that every norm can be 
defined by some symmetric convex body V. To verify this assertion, we 
consider the Set V consisting of all vectors i for which |^| 5 1. We 
shall first show that K is a symmetric convex body in K". 

To show that V is convex, let ^ e K and tj^V, and letO <. a <, 1. 
Then, by properties 3 and 4 of norins, 

lai -H (1 - ohll ^ llfl^l + - ^ ^l^i + (1 - • 
■ Since Ut ^ ^ M\ < 1, we have 

, /■ \\a^ + (1 - a)r)\\ ^ o + (I ~ fl) = 1 , ^ 

that is, the vector ai + 0 - ah also belongs to the set V; thus, K is^ 
convex. 

Second, we must show that the origin is^an interior point of the set V. 
If i is an arbitrary nonzero vector, we obtain upon setting a\~ 
that - . 



that is; aieV. If ^ = 0, then for any positive real number a, ai e V, 
since by property 2, = fOU 0 ^ 1. • * 

The symmetry of the>et V follows from property 3 ; if | - 1| = 
= = 11111 < 1. Soif |g K, then K ' - 

The proof of the boufldedness of the set Kis somewhat more cumber- 
some, and so we shall omit it. 

* Since the set K is a convex body, it defines a norm n, denoted by 
"(I) = 11? Ik- It itill remains to be shown that this norm coincides with 
,the one chesen at the beginning of the proof. Let a be an jirbitrary 
positive nym^ber for which a^^ This means ihat \\q^\\ < !, which 

3. In honor of tHe great mathematician H. Minkowski, one of the creators^of 
the theory of relativity. * 
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implies that ajjfH ^ I, or I/a s H^i- So if e Ija S i^i, and the . 
least such 1/a is obtained by setting I la strictly eqilal to ; that is, by 
setting a = In other words, the greatest lower bound of the Ija 

isj^l, or' 

inf 1 = 1^11 . ' (7.13) 

Comparing equations (7.13) and (7.1 1), we see that 

11^1 = t^Iv.' • ' . (7.14) 

the desired result. 

In the norm defined by a given convex body V has a simple 
physical interpretation. . ^ 

Let us suppose that we have some anisotropic device which propa- 
gates sound waves at various speeds in different directions, and con- 
sider the case in which the speed of soun^l in ppposite directions is the, 
same. 

We now choose a unit of speed (such as miles per hour) and construct 
in each direction from the origin a vector whose length js equal to the 
speed of sound in that direction. We make the further assumption that 
the terminal points of these vectors bound a convex body K Clearly, V 
is bounded, symmetric with respect to the origin, and contains at least 
one interior point, the origin. "^o there is a norm \\i\\y and a metric dy 
defined by <f 

We reave it to the reader to verify that the distance dy{^^ r)) is numeri- 
cally equal to the time required for a sound wave to travel from the 
end of the vector f to the end of ttie vector t] along the straight line 
conntcting them. 

In addition to the finite-dimensional Minkowski spaces, one can 
consider their infinite-dimensibnal analogs — the so-cal!pd Banach 
spaces. In genera!, a Banach space is a vector space on which a norm 
can be defined (that is, a space satisfying all of the properties listed on 
page 49 along with a norm possessing all of Ihe properties listed on 
page 5^). 

' 4. In honor of th\Po!ish mathematician S. Banach (1 892-1945), one of the 
founders of functional analysis -an important brinch of modern mathcmaticSs 
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We^can construct afi example of an infinite-dimensional Banach space 
in the following way: Let C{[Q, 1]) be the set of all continuous functions 
on the closed interval [0, I] = {/ j 0 ^ r ^ 1). The sum of two such 
vectors (in this case, functions) is defined by its operation on a number /; 
that is,/ + g is defined by (/ + ==/(0 + ^0 for/and g elements 
of C([0, 1]). Similarly, the scalar product af (for a € K) is defined by 
{af)(t) - a[fit)l The zero vector is the function 0 defined by 0(r) = 0, 
all / e [Of 1]. As the norm of a function we take the maximum of the 
absolute values of elements of the range, that is, 

' i/i = m^^J/(Oh 



If ^11 



(It can be shown that b^;ause of the choice of the domain [0, 1], such a 
maximum necessarily exists.) 

It is easy to show that all of the previously listed vector spq^ce and 
norm pro^rties are satisfies by the space C([0, 1]) with the norm 
defined above. ^ . • 

Banach spaces in which the vectors are functions play an important 
role in modern mathematics. - . ' 

ThcJ claim that metric spaces whose points are functions are infinite- 
dimensional can in some sense be justified by the following reasoning. 

We partition the closed interval 
[0, 1 ] by . dra>ving vertical lines 
through n of its points (fig. 7.10), 
Now we take the vector f = 
(xi, y;^, . ...x^eW and represent 
its coordinates on these vertical 
lines. The points in the plane 
determined in this way form the 
graph of some function defined on 
the n chosen points. Clearly, as 
' _ n '->oo, this set of points con- 

verges'' to the graph of continuous function if we have chosen points in 
whose coordinates on adjacent vertical lines become arbitrarily 
close as n c3o. if we define ^ norm on'M"" by L 




1^11 - max(jxij, |X: 



2b 



(where | - (x^, x^, . . ;?n) ^ then Ibis norm- "in the limit*' (as 
n -> oo) becomes the norm defined by 
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l/i « max 1/(01. 



whcrc/eC([0, ID. 

The point is that the dimension of the normed space in question, 
increases without bound, indicating that the "limiting'* spaice C([0, 1]) 
is infinite-dimensional. 
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In the measurement of physical quantities^ experimental results often 
appear as a sequence (xu ^a^- • ^m) of observed values. 

The quantity itself can be constant or variable. In the latter case, the 
values Xj, Xa, . . . , should vary according to some law ; in the former 
case, they should be nearly equal. But in any case, the measured quan- 
tities Xi, Xa,. . M^n subject to error. In other -words, there are 
inhercEit -experimental imperfections that hinder the reception of 
information from nature. 

The mathematical probltyn concerned with the treatment of measure- 
ments i§ that of the establishment (so far as possible) of the correct 
information. The solution'^s,in the application of concepts developed 
pi^iviously for the automat icA^rect ion of errors in discrete messages. 

If the measured quantities An take on arbitrary real values, we can 
consider the /i-dimensionai vector space W as our sp^ce of information. 
The distance d(i, ^) between points of this space can be defined to fit the 
experiment being carried out. But^most frequently,, a metric ci of the 
form 

d{i. = Vix,-y,r+^''+iXr.-yJ' (8.1) 

is used, for which the space of information is l2^^\ 

Let AT c IR« be a subset of this spac^ of information. ^ 

As a "correct'' message, we take the vector r) e N *'cIoscst" to the 

message ^ that is received, that is, a vector rj such that 

(if such a vector exists). It can be shown that in the interesting cases (for 
example, when the set consists of all vectors which require the Xi to lie 

* i . 

60 



The Smoothing of J^ors in Experimental Measurements 61. 



^ong some^ curve when piott«i against time coordinates rO such a 
minimum exists, and thus so does the vector t). Foe the metric defined 
by (8.1), this |>rinciple is commonly known as the method of least 
sqmres^ a method introduced by the great German mathematician Karl 
Friedrich Gauss. 

Let us examine alconcrete example of a subset of theoretically 
possible messages, we suppose that the measured quantity changes 
linearly with respect to time, that is, if y is the m^ured quantity, 

y kt + b. 



where k and b are some constants and t is the time.^ 

This means .that each vector jj'e N has the form rj = {yu y^^ - • , >'J, 
where ' . 

^ ' - kti +b,\^ ' 

y2 = kt2 + b , 

& 

Let the vector actually obtained by measuring this quantity be equal 
to ^ = (xi, Xa, . . xj. The fundamental condition (^8.2) is now written 
as follows: 

F{k, b) = {kt,^ b - Xi)^ + {ktr, + /? - Xa)^ + • • ' + (A:/„ + b- xj^ 
=-min. 



In the expression the unknowns are the parameters k and b 

defining the unknown theoretically possible messages; the quantities 
tu ' - y U ^nd Xi, Xa, . , , , Xn are experimentally known, * 

To find the minimum value qf the quantity Fik, b), we use a criterion 
from differential calculus: 



L For the sake of simplicity, we shall assume that the error involved In defining 
moments of iime is negligibie. 
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which, in the given case of a positive quadratic function Fik, b), is 
necessary and sufficient for a minimum. ' 
Let us calculate the partial derivatives: 



dF 
dk 

dF 
db 



= l(kh + 6 - Xi) + • • • + Uktn + i> - xj . 



> (8.4) 



For Qonvenience, we denote 



[/] = /i + /a + • • ■ + . 

[tx] = r^Xi + + • • • + ^n^n , 

[X] = Xi + Xa 4- • • • + X, , 
[I] = 1 + 1 + + 1 = «. 



The expression (8.4) can then be written in the form 



dF 



^ = 2[t^]k + 2[t]b - 2[lx] , 
jy^2{t]k + l{\]b~l{x] 



(8.5) 



Setting these exprg^ons equal to zero in accordance with (8.3), dividing 
by two, and transferring the free tern\s to the right side, we get the 
fundamental equation of the method of least squares in symbolic form: 



\t]k + [\V> = {x}.^ 



(8.6) 



Figure 8.1 pictures measured vahies Xj, x^, X3, X4, Xe, Xg, x,, Xg, and the 
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Table 8 J 





x^ 1 


h 




/,« 


i 
1 


0 20 




0.06 


0.09 


. 2 


0.43 


0.91 


0.39 


0.83 


3 


0.35 


1.50 


0.53 


225 


4 


0.52 


2.00 


1.04 


4.00 


5 


0.81 


2J20 


1.78 \ 


4.84 


6 


, 0.68 . 


2.62 


1.79 ^ 


^ 6.86 


7 


1.15 


3.00 


3,45 * 


9.00 


8 


0.85 


3.30 


2.81 

1^ 


10.89 


2 


[x] = 4.79 


[t] = 15.83 


[tx]^ 11.85 


m - 38.76 



straight line y ^ kt + b defined according to the method of least 
squares. The figure makes it cleat why we speak of the "smoothing" of 
ercprs. 

Table 8.1 shows the order in wh?ch the calculation is carried out. 
The system (8.6) in this case has the form 

2%J6k + 15.83/> = 11-85, 
15.83A + %b - 4.79. 

The solution is A = 0J19, 5 = -0.032. The unknown message" is 
y ^Q3\9t - 0.032. 

Analogously, if the set of theoretically possible messages N consists 
ofall parabolic functions of theform;^ - a/'^ + bt + c, then the funda- 
mental condition (7.1 1) can be written in the form ^ 

F{a, b, c) = {at^ + bt^ + c - x,)^ + ■ + (ar^ bt^ ± c - x^^ 
- = min . 

The minimizir^ig of the functions F(a, k c) reduces to the solution of a 
system of three linear equations in three unknown parameters a, b, 
and c. , 

The method of least squares can also be easily carried out in^he case 
of a metric d of the form 

where ^ - (Xi, x^, . . . , x^) and yj ^ (y^, y^. ^ ^ yn) are elements of R% 
and ai, aa, . . a„ are positive real numbers (weights). Unequal weights 
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must employed if it is known that separate measurements in the 
experiment are not equally exact. In this case, it is necessary to assign 
smaller weights to less accurate measurements. 

The fundamental principle (8.2) for the smoothing of errors can also 
be applied to the metrics of the spaces C^"^ and However, in these 
cases, methods of determining the lefof theoretically possible messages 
are more complicated- * \ 
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9 A More 

^itfk General Definition 
iPof Distance 



.As we have already stated, various generalizations of the notion of 
distance arc possible. One o|; the most radical is used in the theory 
of relativity, where we,consider the space-time universe consisting- of 
points of the form (x, y, 2, /), where x, and z are spatial coordinates 
and / i$ the time coordinate. The distance (space-time interval) bctwwn 
two such points is defined by thdjformula . 



d(L v) = v'c^O - -ix- - {y - yiY - (z - z,y , (9.1) 



where c is the speed of light. It is clear that the metric d can assume 
imaginary as well as real values. ^ 

It is also possible to generalize the concept of distance by assuming 
that a function satisfying axioms 1, 2, 3, and 4 (chap. 3, page 12), can 
have infinite value.^ In this case, however, the space could be partitioned 
into disjoint subsets, each of which would be a metric spac^ in the usual 
sen^. Consequently, such a generalization is not very interesting. The 
profl' of this fact caiTtJ^ketched as folbws. 

Examining such a "generalized'' space £, let us say two elements 
M and iVof £are "equivalent" if the distance d{M,N) is finite. Then, 
clearly, each point M is equivalent to itself, and if M is equivalent to N, 
N is equivalent to M (d{NM^ = d{M,N)). If M is equivalent to i and 
L is equivalent to N, then since 



d(M,N) is finite and M is equivalent to N. Thus the relation of "equiv- 
alence'' partitions the space E into "equivalence classes," each of 
which is an ordinary metric space with a finite distance function. 
1. More precisely, the value -fco. 





66 



A Mor^Ciencral Definition of Distance 



What this example points out is that it is no simple matter to come up 
with a meaningful generalization of an abstract mathematic;^l concept. 
In every ^se, such a generalization must come from a deep study of the 
mathematical objects invpJved and not simply from a formal manipula- 
tion of axioms. The abortive attejnpt described above notwithstanding, 
there do eX|ipi number of mt^n&gful generalizations of the concept of 
metric space, one of which we shall study further. By giving up the 
axiom of symmetry (axiom 1), we obtain a class of spaces which is 
connected with some i;|teresting mathematical objects. 

We shall define a generalized metric space to be a set E and a function 
rf: £ X £ K (meaning that has as its domain the Cartesian prod^uct 
of E with itself and as its range the real numbers) with the following 
properties (here r), and ^ are elements of £*): 

2. The double equality dH, rj) - r% ^) - 0 is satisfied if and only if 

3. d{i,7^) 5 d{i,o + da, 7,1 

Clearly, any ordinary distance 




function satisfies these conditions. 
However, a function nonsymmetric 
with respect to its arguments c*an also 
satisfy Axioms 1, 2, and 3. In fact, we 
introduced such a nonsymmetric 
distance function at the. end of 
chapter 4 in connection with the 
definition of distance as the minimal 
time required for travel from one 



Fig. 9.1 point to another. Since a journey in 

the opposite direction may require 
more time, this metric is, in general, not symmetric, but the triangle 
inequality (and axioms I and 2) are easily verified. 

Another nonsymmetric distance function is definable on the space 
consisting of the ten vertices of the diagram in figure 9.1. 

The distance d{Mi, Mi) between the points A/| and is defined as 
the minimal number of line segments passing against the arrows in a 
path joining Mi and A/^. 

Vox example, 

d{Mu Mio) - 4 ; J(Mio, MO = 0; 
^ J(A/3, M^l d{Mg, Mjj) - 1 ; and so on . 
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aearly, Af^) ^ 0. The condition d(Mu M^) ^ dlM^, M,) - 0 
. (both distances being zero) meaqs that it is possible to join the point Mi 
to the point M^ and to join M^ to Af| by means of line segments directed 
with the arrows; that is, M^ and M^ arc vertices of a closed path on 
which all arrows go the same way. As there arc no such loops in figure 
. 9.1, the equality diM^ M^) ^ d(M^, A/,) 0 implies that the points M^ 
and Afy coincide. Thus, conditions 1 and 2 hold for this nonsymmetric 
distance function. 

The triangle inequality can be verified by the following argument. We 
examine a path with the minimal number of segments directed against 
the arrows joining M, to ^j;^ and an analogous path from to A/^. 
Joining these paths, we obtain a path from Mi to Afy with the number ofr 
line ^gments directed against the arrows equal to </(Afi, Af^) + 
diM^, Afy). Since in the ** shortest** path from Mi to Afy, the number of 
such segments is at least as small, 

d(Mi, Mj) ^ diMi, Mh) + d{Mu, A/y) . (9.2) 

In this example it is possible to define a new metric d^ by the rule 

d'^iMi, A/y) = 4iMi:M,) + (/(Afy, Mi) , (9.3) 

Clearly ^*(Af^, Afy) possesses the properties of an ordinary metric. 
The analogous proposition is true in an arbitrary generalized metric 
space. 

Theorem // (S, d) is a generalized metric space atid d* : S x S->U 
is defined by 

d*iLv) = dii.v) + d{v.O. (9.4) 

then (S, d*) is a metric space in the ordinary sense. 

Proof, The symmetry of the metric d* follows because the right side 
of (9.4) does not change upon interchanging | and j]. The equality 
cJ*{^^ 7^) = 0 is equivalent to the double equality di$, fj) ^ d(r}, I) =^ 0 
(since d takes on no negative values) and is therefore equivalent to the 
statement f Finally, since 

# 

and ■ '. . 
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j 0 

we; get 

' j * ! ■ 



or 



d*ii,v) ^ ^/nf, o^+ ^/*(?,i?), 



and so the triangle inequality holds for the metric d^. I 
Another interesting example of a generalized metric space can be 

obtained using the important concept of a partiajiy ordered set. ^ 
A set 5 is said to be partially ordered if for some ordered pairs of 

points {M,N)eS x 5, the relation *M (( AT (read M precedes iV) is 

defined and satisfies the following axioms^ 

1. If M (( and ^ Af, then M ^ N (antisymmetry). 

2. If M^N and N^L, then M (J L (transitivity). 

An example of a partially ordered set is the set of vertices in figure 9. L 
We set Af^ (( M< if there is a path joining Mi to which moves only in 
the direction of the arrows. For example^ Mg i Afio, (( ^3, (J Af^, 

A ^second example is obtained by considering ({ to denote the relation 
** < on the real line; that is, jc ([ 7 if ^nd only if x < y. In this case, it 
is clear that for each pair of distinct points jc and y eithei^^j'br y(l^x 
is valid. A set with such an ordering (in which for eacinpair of distinct 
points X and y, either x 7 or 7 jc) is said to be linearly ordered by ({, 

In any partially ordered set it is possible to introduce the notion of an 
immediate predecessor. / 

A point M is said to immediately prec/de a point (and we write 
M O N) if M (lN2Ln4 there is no third point L different from A/ and N 
lying *'betwcen^^ and A^; that is, such that M iLiN. 

For example, in figure 9.1, A/g O A/3, A/2 O M^, O A/7, and soon. 

No real number has an immediate predecessor, for if jcO, then 
xil(x + y)l2 (( y, since x < (x + y)l2 < y. 

We now consider a finite partially ordered set E and suppose that that 
set has the property of connectedness; that is, for each pair of points M 
and N in E there exists a sequence of points M = L^, L2, , . . ^ Lf^ ~ N 
such that for each / with 1 < / < ^ — 1, either ^ L^^^i or x ({ L{. 
For the points A/3 and Afg in figure 9.1, for example, we can construct 
such a sequence as follows: 

Lx = A/3 ; Lj = Mi; i L3 — A/7 ; — A/a , 
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der to check that the set of vertices in figure 9.1 is 




Fig, 9.2 



The set of points in figure 9,2 is not 
connoted, since for the points Afg and 
Afa such a connecting sequence does 
not exist. However, the subsets Ei = 
. {A/i, Afa, Afs, A/*} and = {A/g, A/„ 
Af7, Mq) are connected. One can easily 
verify that any finite partially ordered 
set can t>® partitioned into disjoint 
connected subsets. 

We are now in a positionJo introduce 
into an arbitrary partially ordered set E 
a metric d defined according to the 
following rule. We first define a path from a point A/ to a point to be 
a chain of points M = L^, , , /.^ = such that for each / with 
\ < i < k - V either AO t^ + i or L^ + i O t*- We then define the 
distance </(Af, A^) to be the length of the shortest path from M to N~Xhc 
length of a path being defined as the number of integers / such that 
1 < i < k^- 1 and L^^^ O U (that is, the number of steps against 
the arrows"). 

The nonnegativity of the distance diM, N) follows from thesJefmition. 
For the proof of the second axiom of distance we note that for distinct 
points M and A^, the condition d{M, A^) - 0 implies that there exists a 
chain of points M ^ Li, L^, . ...Lf, = N such tftat Li O U^i and, in 
particular, that L^(ILh.i for each /. But then, by the second axiom 
(transitivity) for partially ordered sets, we get that M iN. Analogously, 
from the condition ^/(A, A/) - 0, it follows that A (( A/. Thus, if 
d{M, N) = d{N, Af ) = 0 is satisfied, Af (J and A ^ A/; so, by the first 
axiom (antisymmetry) for partially ordered sets, M ^ N. Conversely, 
if M ^ N, then the length c/(A/, A^) of the shortest path from M to N 
and the length </(A, M) of the shortest path from A to M are equal to 
zero. So the metric d satisfies the second condition for a generalized 
metric. 

For the proof of the third axiom (the triangle inequality) we employ 
a familiar method. Taking a shortest path M ^ LuL^,. -ylk^Q 
from M to Q and a shortest path Q . . ., L;?^^ = A from 

Q to A^, we form a path M ^ Lu ^-a? . . , Q ^ky ^k-^iT- —rJ^k-^v 
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= N from M to M The total number of pairs of adjacent points in this, 
chain for which + ^ O A is equal to the sum of the distan<»s ff(Af, 0 
and diQ, N), Clearly, the number of such pairs in the shortest path 
from M to N can only be smaller: * \ 

d{M, N) S d(M, Q) + d{Q, N) , (9,5) 

And we have shown that for any finite connected partially ordered set 
E we can define a metric d so that (£, d) forms a metric space. 

As an exercise, we suggest that the reader prove that for every pair of 
points M and N where M([N, the distance diA^, N) ^ 0, 
, In a sense, the converse assertion is also true. In any generalized 
metric space {E, d) it is possible to introduce a partial ordering i defined 
hy MiN\^d{M,N) - 0. 

To prove this, we must show that both axioms for a partial ordering 
are satisfied. If Af ({ and M, then d{M, N) - diN, M) 0, and ' 
by the second condition for a generalized metric, Af = A^, The first 
axiom for partially ordered sets i«^hus proved. 

Now let V d and L AT. Then diM, L) - 0 and d(L, N) = 0. By 
the triangle ihequality 

d(M, N) S d(M, L) + diU N)^0 ; 

but by nonnegativity, 0 <: d(M, N), and so 0 ^ d{M, N) ^ 0; that is, 
• diM, N) = 0 and M (I N. 
. Thus, we have shown that if M ^ L and L (J A^, then MiN. 
The partially ordered set wljich we obtain in this way need not be 
connected. 

Examining, for example, the partially ordered set E of the points in 
figure 9.2, one can define ^twecn * pairs of points from the subset 
El ■= {Afi, Ma, A/3, Af4} a distance by means of the shortest path. The 
same can be done for the subset E^ ^ {^^5, M^, A/7, Mq). We further 
define* the distance between a point Mi e E^ and a point Af^ e £3 by 

d{M,, Mj) - d{M^, A/,) - 100 . (9.6) 

It is easy to verify that wc get a generalized metric space in which the 
cqmWty d{M, N) 0 is equivalent to the relation A/ ([ AUn the partially 
ordered set £\ As we have already remarked, however, E is not a 
connected set. 

It is possible, however, to introduce the notion of a connected 
generalized metric space. The space (E, d) is said to be connected if for 
^ny pair of (not necessarily distinct) points Af and A^ of if there exists a 
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chain of points M = iLj, Z^, . . . , L^c = N such that for each adjacent 
pair of points Lx and Li^i either d{Li,Li^i) = 0 or d(Li^ijL^ = 0. 
We leave it to the reader to verify that any connected generaliz^^i metric 
space corresponds to a connected partially ordered set. 

A finite partially ordered set (and the corresponding metric apace) 
can be represented geometrically in a very simple manner. We depict the 
elements of the partially ordered set as points in three-dimensional ^pace 
denoted by the same letters as the corresponding elements. We join each 
pair of points M and N for which M Q N by a line segment directed 
from to A/, indicating the direction by an arrow. The geometric 
figure obtained, consisting of the points (vertices) and the directed line 
segments joining them, is called a gr<tph» We have already seen examples 
of graphs in figures 9.1 and 9.2. 

|t is ?asy to see that if M (IN, it is possible to travel from N to M by 
means of a path that moves only in the direction of the arrows. 

Metric spaces with nonsymmetric distances functions are especially 
important in the ccv^cept of a discrete topological space* 

With this we conclude our study of the concept of distance. We have 
established that this concept in its many different aspects fs connected 
rtot only with proi^lems in pure mathematics, but with such practical 
problems as the construction of error-stabilizing codes. This muljtiplicilty 
of applications and the complicated logical connections are characteris- 
tic of other essential mathematical concepts as weJl.^ The principal 
motivation for the creation of such concepts lies in the possibility of 
connections and analogies to seemingly unrelated fields andin the need 
to discover the hidden principles upon which mathematical properties 
depend. 
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